Writing tagged transformers

A practical curriculum with courses, causal experiments, Mac workflows and a research portfolio path.

A systems-level explainer for transformer computation, attention, dense layers, prefill, and decode.

Interactive calculator for linear-layer work, quadratic attention, prefill, and decode.

Live KV-cache memory sizing for MHA, GQA, and MQA.