What Is ChatGPT Doing ... and Why Does It Work?

Nobody expected this—not even its creators: ChatGPT has burst onto the scene as an AI capable of writing at a convincingly human level. But how does it really work? What's going on inside its "AI mind"? In this short book, prominent scientist and computation pioneer Stephen Wolfram provides a readable and engaging explanation that draws on his decades-long unique experience at the frontiers of science and technology. Find out how the success of ChatGPT brings together the latest neural net technology with foundational questions about language and human thought posed by Aristotle more than two thousand years ago.

Information and Media Inquiries

March 9, 2023 Publication
Publicity and Interviews: sw-media@wolfram.com
Translation Rights Requests: info@dropcap.com
Trim Size: 6" x 9"
Non-Fiction: Technology/Computers

Distribution by Ingram, Amazon and Baker & Taylor
UK Distribution: Turnaround Publisher Services

Contents

• Preface

• It's Just Adding One Word at a Time
• Where Do the Probabilities Come From?
• What Is a Model?
• Models for Human-Like Tasks
• Neural Nets
• Machine Learning, and the Training of Neural Nets
• The Practice and Lore of Neural Net Training
• "Surely a Network That's Big Enough Can Do Anything!"
• The Concept of Embeddings
• Inside ChatGPT
• The Training of ChatGPT
• Beyond Basic Training
• What Really Lets ChatGPT Work?
• Meaning Space and Semantic Laws of Motion
• Semantic Grammar and the Power of Computational Language
• So ... What Is ChatGPT Doing, and Why Does It Work?
• Thanks

• ChatGPT and Wolfram|Alpha
• A Basic Example
• A Few More Examples
• The Path Forward

• Additional Resources

About the Author

Stephen Wolfram is an award-winning scientist and bestselling author, and the creator of some of the world's most respected software systems—Mathematica, Wolfram|Alpha and Wolfram Language. For more than 35 years, he has been CEO of the global technology company Wolfram Research, as well as responsible for a series of groundbreaking advances in basic science, including the recent Wolfram Physics Project.
www.stephenwolfram.com

Other Books by Stephen Wolfram

• The Second Law: Resolving the Mystery of the Second Law of Thermodynamics
• Metamathematics: Foundations & Physicalization
• Twenty Years of A New Kind of Science
• Combinators: A Centennial View
• A Project to Find the Fundamental Theory of Physics
• Adventures of a Computational Explorer
• Idea Makers: Personal Perspectives on the Lives & Ideas of Some Notable People
• An Elementary Introduction to the Wolfram Language
• A New Kind of Science