Attention and Transformer (Technical Deep Dive)
Q·K·V, Scaled Dot-Product Attention, multi-head, causal masking, and the Transformer block — a technical look at how an LLM computes
Q·K·V, Scaled Dot-Product Attention, multi-head, causal masking, and the Transformer block — a technical look at how an LLM computes