The Birth of a Token
A 95-second film of one GPT-2 forward pass — the prompt “Attention is all you” becoming its next word. Companion to the Transformer Architecture book.
THE BIRTH OF A TOKEN
ONE FORWARD PASS · GPT-2
CLICK TO BEGIN
A 95-second film of one GPT-2 forward pass — the prompt “Attention is all you” becoming its next word. Companion to the Transformer Architecture book.
ONE FORWARD PASS · GPT-2
CLICK TO BEGIN