The Birth of a Token

A 95-second film of one GPT-2 forward pass — the prompt “Attention is all you” becoming its next word. Companion to the Transformer Architecture book.

THE BIRTH OF A TOKEN

ONE FORWARD PASS · GPT-2

CLICK TO BEGIN