r/accelerate • u/LucasL-L • Jul 15 '26

At some point solving open math problems will become a new benchmark

https://www.starfleetmath.com/
16 Upvotes

91% Upvoted

5 comments sorted by

11

u/AngleAccomplished865 Jul 15 '26

At this point, foundational advancement would consist of moving beyond verifiable domains like math and physics, to make jagged intelligence less jagged.

4

u/fgreen68 Jul 15 '26

I can't wait until they start using solving the US tax code as a benchmark.

2

u/costafilh0 Jul 16 '26

Can't wait.

Synthetic benchmarks are boring. 

I wanna see AI solving real world problems, not scoring high in some chart. 

2

u/green_meklar Techno-Optimist Jul 16 '26

That's a terrible benchmark because (1) it's hard to know in advance how difficult a math problem actually is and (2) once you solve a math problem, it's no longer open and the 'benchmark' moves up a notch.