I'm in total agreement with Ross. It's far easier to assemble talent then it is to make an organization that churns out top models one after another. I had a bunch of conversations earlier this year specifically on the tradeoffs and wrote a detailed piece on it.
Ross Taylor
Ross Taylor16.7. klo 11.42
It’s funny that people on this site think major LLM efforts are talent-bound rather than org-bound. The talent differential has never been big between major orgs. Most of the difference in outcomes is due to organisational factors - like allocating compute to the right bets, and letting good research and engineering triumph over destructive politics. This makes for a less sexy story though. People prefer to believe that breakthroughs are made by lone geniuses - instead of the cumulative effort of many nameless, social media averse people — supported by an org that allows the best ideas to win and manages big egos. If you don’t believe me - then consider how some researchers suddenly gain or lose impact and productivity when they switch orgs. Was it because they gained or lost IQ points? 🙂 (Sorry, this is super obvious to anyone who’s actually worked in these labs - but you wouldn’t believe it based on the X feed right now!)
17,64K