Local LLMs, Explained Like You're 5

heymleo
heymleo
348 followers
4 Video Views·Nov 19, 2026

In March 2023, Meta's LLaMA model leaked through a link on 4chan, and a week later one programmer, Georgi Gerganov, had it running on an ordinary MacBook. Follow how llama.cpp squeezed every number down to four bits, how Alpaca, Vicuna, Llama 2, Mistral, Ollama and DeepSeek-R1 put AI on everyone's computer, and why most people still use AI in a data center. Plus a rule of thumb for what fits on your laptop: at four bits, about half a gigabyte per billion numbers.

Chapters
00:00 The leaked file
00:31 The AI you couldn't download
02:04 Hacked in an evening
02:42 Smaller numbers
03:32 Everyone's computer
04:45 Free for everyone
06:10 Why we still pay the cloud
07:51 Know which computer is thinking