“Did the Transformers paper basically replace and kill all other AI algorithms — from the early models of 1945 up to ChatGPT — or not?”
🧵 1
j
Jack Boswell
10/16/2025, 9:35 AM
No, we still see many non-transformers today, even in places that might surprise you!
🙌 2
Jack Boswell
10/16/2025, 9:38 AM
I imagine a large swathe of the transformer-based models we see today will eventually be replaced, but the architecture will have a place for a very long time
It's particularly good at summarising, especially given current compute constraints.