{ "@context": "https://schema.org", "@id": "https://aggr.aymericbeaumet.com/items/computerenhance-com/2026-10-27-what-s-in-a-token/#webpage", "@type": [ "WebPage", "ArchiveComponent" ], "articleBody": "[www.youtube.com](https://www.youtube.com/watch?v=aQvSG8paVjM)\n\n“Glorified autocomplete” and “stochastic parrot” are terms you will often heard used to describe LLMs in a derogatory way. What constitutes “autocomplete” is in the eye of the beholder, but there’s good reason to consider LLMs to be a different type of algorithm in kind.\n\nIn this episode of *Wading Through AI*, Demetri gives an overview of the mechanics of modern LLM architectures so that listeners can decide for themselves how they’d like to mentally categorize them in the pantheon of existing algorithms.\n\n*As always, the art for the thumbnail, podcast cover, and banner of Wading Through AI were all hand-drawn by [Anna Rettberg](https://x.com/aerettberg) in her signature style. We do not currently use generative AI here at [Molly Rocket](https://mollyrocket.com/).*\n", "authors": [], "captured_at": "2026-10-27T20:37:14.562886086+00:00", "category": "programming", "content_html": "

www.youtube.com

\n

“Glorified autocomplete” and “stochastic parrot” are terms you will often heard used to describe LLMs in a derogatory way. What constitutes “autocomplete” is in the eye of the beholder, but there’s good reason to consider LLMs to be a different type of algorithm in kind.

\n

In this episode of Wading Through AI, Demetri gives an overview of the mechanics of modern LLM architectures so that listeners can decide for themselves how they’d like to mentally categorize them in the pantheon of existing algorithms.

\n

As always, the art for the thumbnail, podcast cover, and banner of Wading Through AI were all hand-drawn by Anna Rettberg in her signature style. We do not currently use generative AI here at Molly Rocket.

\n", "content_markdown": "[www.youtube.com](https://www.youtube.com/watch?v=aQvSG8paVjM)\n\n“Glorified autocomplete” and “stochastic parrot” are terms you will often heard used to describe LLMs in a derogatory way. What constitutes “autocomplete” is in the eye of the beholder, but there’s good reason to consider LLMs to be a different type of algorithm in kind.\n\nIn this episode of *Wading Through AI*, Demetri gives an overview of the mechanics of modern LLM architectures so that listeners can decide for themselves how they’d like to mentally categorize them in the pantheon of existing algorithms.\n\n*As always, the art for the thumbnail, podcast cover, and banner of Wading Through AI were all hand-drawn by [Anna Rettberg](https://x.com/aerettberg) in her signature style. We do not currently use generative AI here at [Molly Rocket](https://mollyrocket.com/).*\n", "dateCreated": "2026-10-27T20:37:14.562886086+00:00", "date_created": "2026-10-27T16:28:02+00:00", "date_modified": "2026-10-27T16:28:02+00:00", "date_published": "2026-10-27T16:28:02+00:00", "description": "Listen now (116 mins) | Is “glorified autocomplete” a good description of what LLMs do, or are there substantial qualitative differences under the hood?", "external_url": "https://www.computerenhance.com/p/whats-in-a-token", "git": { "commit": "20068632b65d2830a2d54f25ca1d90d697bea2c0", "path": "items/computerenhance-com/2026/10/2026-10-27-what-s-in-a-token.md", "permalink": "https://github.com/aymericbeaumet/aggr-instance/blob/20068632b65d2830a2d54f25ca1d90d697bea2c0/items/computerenhance-com/2026/10/2026-10-27-what-s-in-a-token.md" }, "id": "urn:aggr:item:313f1094965e9ad19462b9cfb8dcff0e0c3117ec", "isBasedOn": { "@id": "https://www.computerenhance.com/p/whats-in-a-token" }, "mainEntity": { "@id": "https://www.computerenhance.com/p/whats-in-a-token", "@type": "CreativeWork", "archivedAt": { "@id": "https://aggr.aymericbeaumet.com/items/computerenhance-com/2026-10-27-what-s-in-a-token/#webpage" }, "dateModified": "2026-10-27T16:28:02+00:00", "datePublished": "2026-10-27T16:28:02+00:00", "headline": "What’s in a Token?", "image": { "@type": "ImageObject", "caption": null, "height": 90, "url": "https://substackcdn.com/image/fetch/$s_!PMjn!,w_1200,h_600,c_fill,f_jpg,q_auto:good,fl_progressive:steep,g_auto/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc951f19b-16d6-4f80-8690-a647746a3ac8_1920x1080.png", "width": 160 }, "timeRequired": "PT1M", "url": "https://www.computerenhance.com/p/whats-in-a-token", "wordCount": 121 }, "name": "Archived snapshot: What’s in a Token?", "preview": { "alt": null, "color": null, "height": 90, "placeholder": { "data_url": "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAQAAAC1HAwCAAAAC0lEQVR42mNk+A8AAQUBAScY42YAAAAASUVORK5CYII=", "hash": "" }, "url": "https://substackcdn.com/image/fetch/$s_!PMjn!,w_1200,h_600,c_fill,f_jpg,q_auto:good,fl_progressive:steep,g_auto/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc951f19b-16d6-4f80-8690-a647746a3ac8_1920x1080.png", "width": 160 }, "reading_minutes": 1, "replicated_at": null, "source": "computerenhance-com", "source_name": "Computer, Enhance!", "summary": "Listen now (116 mins) | Is “glorified autocomplete” a good description of what LLMs do, or are there substantial qualitative differences under the hood?", "tags": [], "temporalCoverage": "2026-10-27T20:37:14.562886086+00:00", "title": "What’s in a Token?", "url": "https://aggr.aymericbeaumet.com/items/computerenhance-com/2026-10-27-what-s-in-a-token/", "word_count": 121 }