More parameters give a model more room to hold what it read; more tokens give it more to learn from. talkie is small on both counts, and it is also weak at reasoning a problem through.
The outside guesses come from an analyst who measured how much each model knows, and they cover the previous version of each model. They span a factor of ten, so read them as a sense of scale, not as facts. If they are roughly right, today's leading models are somewhere between 50 and 500 times talkie's size. The open model in the last row, released two years ago, is already about 30 times talkie's size.
Size is not the only gap. talkie read 260 billion tokens, all printed before 1931. Llama 3.1 read about 15 trillion, nearly 60 times as much. Google, Anthropic and OpenAI have not said how much their models read.
What is a token? Before a model reads anything, it cuts the text into tokens. A common word is usually one token; a rare word or an old-fashioned name is split into pieces. In English a token averages about three-quarters of a word, so talkie's 260 billion tokens come to roughly 200 billion words. To watch it happen, paste a sentence from your excerpt into the
OpenAI Tokenizer or
Tiktokenizer (no sign-in needed) and see which words get split.
Sizes as of November 6, 2026. Sources are in the footer of this page.