No black boxes
Nothing is hidden behind a library call. You build every layer yourself, from tokenizer to training loop, so you understand exactly how it works.
Learn how large language models actually work by building one from scratch in Node.js and TypeScript.
No black boxes
Nothing is hidden behind a library call. You build every layer yourself, from tokenizer to training loop, so you understand exactly how it works.
From scratch
Tokenizer, dataset/dataloader, attention, transformer block, GPT, and the training loop built up chapter by chapter.
Runnable
Every chapter has a runnable entry point in the @node-llm/chapters package.
Interactive
Live WebGPU demos from the @node-llm/playground package are embedded throughout.