“Did the Transformers paper basically replace and ...
# random
z
“Did the Transformers paper basically replace and kill all other AI algorithms — from the early models of 1945 up to ChatGPT — or not?”
🧵 1
j
No, we still see many non-transformers today, even in places that might surprise you!
🙌 2
I imagine a large swathe of the transformer-based models we see today will eventually be replaced, but the architecture will have a place for a very long time It's particularly good at summarising, especially given current compute constraints.
🙌 2