Must Watch Video: Introduction to LLMs by Karpathy

Andrej Karpathy's 1-hour video on Large Language Models is one of the best introductions to Large Language Models

Andrej Karpathy is one of those rare people who are both: working at the cutting edge of a fast-changing and important technology and extremely good at explaining it in terms that anyone can understand. He is currently working at OpenAI on ChatGPT and related technologies (more accurately, in his own words, he’s trying to build something similar to J.A.R.V.I.S. from Iron Man).

He has just published a 1-hour video on YouTube which gives a great introduction to Large Language Models (LLMs). LLM is the name given to technologies like OpenAI’s ChatGPT, Google’s Bard, Meta’s Llama, Anthropic’s Claude, and others. If you’ve been reading this newsletter you know that I think this is one the most important technologies today and will change all our lives in the next few year.

Hence, getting a feel for how the technology works is important. So, here’s the video:

(Note: there are very few visuals on the screen, so you can listen to it like a podcast too, if you prefer that.)