 Название: What Is ChatGPT Doing ... and Why Does It Work?
Автор: Stephen Wolfram
Издательство: Wolfram Media
Год: 2023
Страниц: 109
Язык: английский
Формат: pdf, azw3, epub
Размер: 14.6 MB
Nobody expected this—not even its creators: ChatGPT has burst onto the scene as an AI capable of writing at a convincingly human level. But how does it really work? What's going on inside its "AI mind"? In this short book, prominent scientist and computation pioneer Stephen Wolfram provides a readable and engaging explanation that draws on his decades-long unique experience at the frontiers of science and technology. Find out how the success of ChatGPT brings together the latest neural net technology with foundational questions about language and human thought posed by Aristotle more than two thousand years ago.
This short book is an attempt to explain from first principles how and why ChatGPT works. In some ways it’s a story about technology. But it’s also a story about science. As well as about philosophy. And to tell the story, we’ll have to bring together a remarkable range of ideas and discoveries made across many centuries.
For me it’s exciting to see so many things I’ve so long been interested in come together in a burst of sudden progress. From the complex behavior of simple programs to the core character of language and meaning, and the practicalities of large computer systems—all of these are part of the ChatGPT story.
This book consists of two pieces that I wrote soon after ChatGPT debuted. The first is an explanation of ChatGPT and its ability to do the very human thing of generating language. The second looks forward to ChatGPT being able to use computational tools to go beyond what humans can do, and in particular being able to leverage the computational knowledge “superpowers” of our Wolfram |Alpha system.
Before we go on I should explain that for purposes of exposition I’m mostly not going to use the full system that’s in ChatGPT ; instead I’ll usually work with a simpler GPT-2 system , which has the nice feature that it’s small enough to be able to run on a standard desktop computer. And so for essentially everything I show I’ll be able to include explicit Wolfram Language code that you can immediately run on your computer.
Contents:
Preface
What Is ChatGPT Doing ... and Why Does It Work?
It's Just Adding One Word at a Time
Where Do the Probabilities Come From?
What Is a Model?
Models for Human-Like Tasks
Neural Nets
Machine Learning, and the Training of Neural Nets
The Practice and Lore of Neural Net Training
“Surely a Network That’s Big Enough Can Do Anything!”
The Concept of Embeddings
Inside ChatGPT
The Training of ChatGPT
Beyond Basic Training
What Really Lets ChatGPT Work?
Meaning Space and Semantic Laws of Motion
Semantic Grammar and the Power of Computational Language
So ... What Is ChatGPT Doing, and Why Does It Work?
Thanks
Wolfram|Alpha as the Way to Bring Computational Knowledge Superpowers to ChatGPT
ChatGPT and Wolfram|Alpha
A Basic Example
A Few More Examples
The Path Forward
Additional Resources
Скачать What Is ChatGPT Doing ... and Why Does It Work?
|
Навигация
Вход на сайт
Реклама
What Is ChatGPT Doing ... and Why Does It Work? 
