LIVE · BENGALURU EST. 2024
★ Lab / Quests / Q-04
Q-04

Transformers from Scratch

How attention turns a bag of words into understanding

The architecture behind every modern LLM, rebuilt from the one idea that started it: a word has no fixed meaning — it assembles one from the words around it. Deriving attention, multi-head, masking, and positional encoding the same way I study everything else — invent it from the problem up, mock it hard, then build the intuition in public.

1
Experiments
0
Achievements
0
Learnings
At
Elements
2026-07 → present
Timeline
☉ A word has no meaning until it reads the room.
1RgRAG0
2EmEmbed0
3RkRerank0
4EvEvals0
5ClCalibrate0
6BmBenchmark0
7MlMLOps0
8LtLatency0
9CsCost0
10ScScale0
11PrPrompts0
12SfSafety0
13DbDebug0
14NtNotes0
15ThTheory0
16OpOptimise0
17AtAttention1