Gemini had SoTA attention and SoTA pretraining before Noam Shazeer came back (he's cited once in 1.5), and now has meh attention and is at best on par with Anthropic on pretraining. If you think this is what will #saveopenai, I question your ability to resist cults of personalty
Many users mocked the cult of personality around Noam Shazeer's return as overblown hype that ignores Gemini 1.5's prior strengths.
No Digg Deeper questions have been answered for this story yet.
The point isn't that Shazeer made Google's position worse, it's that I don't think he's the secret ingredient that makes Gemini's pretraining better. He just knows the recipe. This is a W for OpenAI, but not such a great one as people imagine. And it's not a big L for Google.
Gemini had SoTA attention and SoTA pretraining before Noam Shazeer came back (he's cited once in 1.5), and now has meh attention and is at best on par with Anthropic on pretraining. If you think this is what will #saveopenai, I question your ability to resist cults of personalty
@teortaxesTex vision is now available on all accounts, v4.1 flash is probably on the way
@teortaxesTex Google owns 14% of Anthropic. They don't want to jinx the IPO by releasing a stronger model ...
@teortaxesTex I feel like they need saving from debt more than the competition. Their models are fine. A bit pricy per task, esp given the latest GLM, but bench well enough.
@teortaxesTex Gemini 3 still feels like amazing pretraining. Keep in mind, 3 pro costs about the same to serve as sonnet. They just have a post-training issue. Probably worse midtraining too.
@teortaxesTex hahaha fake god
@teortaxesTex We'll see in a year.
@teortaxesTex Exactly — the narrative around individual hires as silver bullets is almost always overblown. This is a solid pickup but not a game-changer.
@teortaxesTex The cult of personality around Noam really is wild—people forget Gemini was legit before he returned.
@teortaxesTex yes but gemini 1.5's long context lead already left for oai earlier this month
@teortaxesTex probably wrong, got feeling Lukasz Kaiser is on something, and he thought needed Noam Shazeer on the thing he is on, he might have help bringing him along...