Q-04
Transformers from Scratch
How attention turns a bag of words into understanding
The architecture behind every modern LLM, rebuilt from the one idea that started it: a word has no fixed meaning — it assembles one from the words around it. Deriving attention, multi-head, masking, and positional encoding the same way I study everything else — invent it from the problem up, mock it hard, then build the intuition in public.
☉ A word has no meaning until it reads the room.
1RgRAG0
2EmEmbed0
3RkRerank0
4EvEvals0
5ClCalibrate0
6BmBenchmark0
7MlMLOps0
8LtLatency0
9CsCost0
10ScScale0
11PrPrompts0
12SfSafety0
13DbDebug0
14NtNotes0
15ThTheory0
16OpOptimise0
17AtAttention1
★ EXPERIMENT TIMELINE · 1 ENTRY