Inside a language model

A decoder-only transformer predicting the next word. Two of its many layers are drawn, and the numbers are illustrative.

By Todd McCaffrey, with Claude. Part of Sionnach.

Drag to orbit. Scroll to zoom. Hover a part.
Could not load the 3D library. Reload the page to try again.