transformer architecture

The neural network design behind modern language models, introduced in a 2017 paper, that computes output using attention over an entire input sequence rather than processing tokens strictly in order.

also written as transformer