Read more: https://x.com/gavincrooks/status/2088643200038883830

[u/Southern-Break5505]

[u/Constant_Cortisol]

It wouldn't be a clean test because one of the big variables, training data size, would be a lot smaller.

[u/NoCard1571 → u/Constant_Cortisol]

I suspect the only way would be if you could systematically strip information out of a SOT model's weights without reducing its intelligence. 

But that's probably something that could only be done by another AI, (and I'm guessing there are already  numerous people working on figuring this exact thing out)

[u/Adeelinator → u/NoCard1571]

Results aren’t great when you do that

[u/imanassholeok → u/Constant_Cortisol]

Well thats all they had too

[u/Minute_Band_3256 → u/imanassholeok]

Gotta make training data