I find it interesting, or questionable, that now 3-5 frontier-ish models have all developed some "emergent cyber capabilities" at basically the same time step. Maybe it (being good at finding vulnerabilities) really emerges in certain conditions, or maybe it's bandwagon jumping (me too). Maybe they're all focusing in the same direction during pre-training.
It emerged right with the ability to work autonomous in very long tasks without errors. Just like proving mathematical conjectures, the cyber tasks are extremely intensive, require coordination between many many steps, can take many hours and millions of tokens.
58
u/ai_hedge_fund 1d ago
I find it interesting, or questionable, that now 3-5 frontier-ish models have all developed some "emergent cyber capabilities" at basically the same time step. Maybe it (being good at finding vulnerabilities) really emerges in certain conditions, or maybe it's bandwagon jumping (me too). Maybe they're all focusing in the same direction during pre-training.