Chapter 4 · GPT Model
Chapter 4 starts from a single layer of neurons, then assembles the pieces (normalization, feed-forward, and attention) into a transformer block, and finally stacks blocks into the full GPT.
Lessons
Section titled “Lessons”@node-llm/core→src/model/block.ts,src/model/gpt.ts(GPT_CONFIG_124M)- Runnable:
pnpm ch04