Research

Attention Is All You Need: What the Paper Actually Says

The 2017 paper that eliminated RNNs is more specific than the textbook version. Here's what Vaswani et al. actually designed, what they proved in ablations, and which parts of the original architecture modern models quietly replaced.