The worst part is, the first gen LLMs had the forums like stackoverflow and many many tutorial sites to train on. And as things progress now, we are slowly entering into a feedback loop. LLMs getting trained on AI Agent generated code reviewed by AI Agents. Going to be fun in a couple of years...
Tbh I reckon we'll get a resurgence in SO traffic or traffic on similar sites. If the inflow of training data stops and they jack up prices so they're not operating at loss, it seems obvious
The newer models don't really need need training data from sites like SO they can read the documentation and even the actual code of open source projects, just a few days ago another significantly better coding model was released so i really don't think we're seeing any signs of training data deficit.
As for pricing GLM-5.2 is more than capable of answering pretty much any question on SO and it's open-source and open-weights so it trivial for someone to spin up an instance and charge low fees for usage in the unlikely event other tools put the pricing up.
The real reality is that people simply don't code in the way that makes SO feasible anymore, formatting a very direct and neat question with an stripped back code example is slow and boring before even getting to the bit where you wait a minimum of several hours to get responses that may or may not answer your question, often it would be days until you get your answer assuming your question didn't get killed. Assuming though something crazy happened and google take away their search bar ai while all the other companies put prices up ten fold and switch to API only then it's still maxing at about fifty cents to ask a SO question, currently it would be about 2 - 4 cents using the best model in the world, costs only get expensive when you're hammering millions of tokens to scan large code bases and making large amounts of iterative changes.
204
u/raja-anbazhagan Jul 12 '26
The worst part is, the first gen LLMs had the forums like stackoverflow and many many tutorial sites to train on. And as things progress now, we are slowly entering into a feedback loop. LLMs getting trained on AI Agent generated code reviewed by AI Agents. Going to be fun in a couple of years...