Model Microscope

A language model, opened up three ways on the same prompt: what it would say if it stopped at each layer, which words it looks back at, and which parts actually hold the fact. Pick a case on the left.

GPT-2 medium (355M parameters, 24 layers). Everything was computed ahead of time by trace.py; nothing runs in your browser.