“I don’t like calling them scaling laws. They're not actual laws.” @ilblackdragon, co-author of Attention Is All You Need and co-founder of @NEARProtocol, joined our CEO @omeragoldberg to discuss why future AI breakthroughs may come from improved training and formal reasoning rather than larger models.
2/ Here’s a breakdown of the Attention Is All You Need paper on Chaos AI:
64,88K