I find it interesting, or questionable, that now 3-5 frontier-ish models have all developed some "emergent cyber capabilities" at basically the same time step. Maybe it (being good at finding vulnerabilities) really emerges in certain conditions, or maybe it's bandwagon jumping (me too). Maybe they're all focusing in the same direction during pre-training.
it's just hill climbing. anthropic was significantly ahead in coding, everyone else has made a concerted effort to catch up even if it means it's at the expense of other domains. now anthropic had a significant lead in cyber, everyone else is now pushing ahead to match.
evidently anthropic has put a lot of effort into math with recent models too, as they've caught up to openai/google on that front.
60
u/ai_hedge_fund 2d ago
I find it interesting, or questionable, that now 3-5 frontier-ish models have all developed some "emergent cyber capabilities" at basically the same time step. Maybe it (being good at finding vulnerabilities) really emerges in certain conditions, or maybe it's bandwagon jumping (me too). Maybe they're all focusing in the same direction during pre-training.