What’s in a Token?

“Glorified autocomplete” and “stochastic parrot” are terms you will often heard used to describe LLMs in a derogatory way. What constitutes “autocomplete” is in the eye of the beholder, but there’s good reason to consider LLMs to be a different type of algorithm in kind.

In this episode of Wading Through AI, Demetri gives an overview of the mechanics of modern LLM architectures so that listeners can decide for themselves how they’d like to mentally categorize them in the pantheon of existing algorithms.

As always, the art for the thumbnail, podcast cover, and banner of Wading Through AI were all hand-drawn by Anna Rettberg in her signature style. We do not currently use generative AI here at Molly Rocket.