The transformer breakthrough occurred in 2017.

Every transformer-based AI model since 2017 uses an attention mechanism where compute scales quadratically with context length.