Skip to the note
notes
octlm
notes · 2 so far
octlm
A language model built from scratch in October, one drawn day at a time
day 1 · 13 chapters
Attention
From raw bytes to the next token
day 2 · 7 chapters
Modern decoder architecture
From the 2017 block to a 2024 LLM block