Understanding systems, from first principles.
Notes on dynamics, learning, and intelligent systems.
Textbooks
Building an LLM from scratch
The mathematics, architecture, and training behind language models. One mechanism at a time.
Reasoning Models
How models learn to reason, and how additional computation can change what they solve.
Making Custom Agents Work
From a model with tools to a system you can understand, evaluate, and rely on.
Latest writing
All articlesA knowledge base should be a place to think
On writing explanations that can grow, connect, and change as understanding improves.
EssayEvaluating bounded agents
A small worked example separating task success, step budgets, and execution cost.
Research noteLinear algebra for language models
Vectors, matrix shapes, inner products, and the transformations behind attention.
Chapter