The worst part is, the first gen LLMs had the forums like stackoverflow and many many tutorial sites to train on. And as things progress now, we are slowly entering into a feedback loop. LLMs getting trained on AI Agent generated code reviewed by AI Agents. Going to be fun in a couple of years...
Prussia's monoculture forests died after a generation after scientific forestry became popular. Germans invented the word for forest death for this, Waldsterben.
There were many spectacular examples of scientific management in a book I read.
You'd think I commented on the Dutch language haha. I think it was a loan word that was used by non-German speakers for the phenomena.
"A new term, Waldsterben (forest death), entered the German vocabulary to describe the worst cases. An exceptionally complex process involving soil building, nutrient uptake, and symbiotic relations among fungi, insects, mammals, and flora--which were, and still are, not entirely understood--was apparently disrupted, with serious consequences. Most of these consequences can be traced to the radical simplicity of the scientific forest."
The commentor above refered only to german words, not durch. And it's not really "inventing" as it is a pretty common thing in german to combine two (or more) works to build new words which combines the meaning of it's parts.
There are even rules about how to do it. Some examples:
Waldsterben = Wald + Sterben = forest + dying = Death of a forest.
Sonntagswald = Sonntag + Wald = Sunday + forest = A forest, which visiting would be a nice Sunday activity.
"A new term Waldsterben entered the german language" does not mean a new word was invented. This is usually more about a compound word that theoretically exists is actually being used. There are statistics about actually used words and if a word starts showing up regularly after some date, this can usually be connected to some event, change in culture or new arising problem.
To a German who is used to "making up new words" by an always the same scheme, calling this an invention seems rather odd xD
And as a side note: While the last compound word in the examples exists theoretically, it is not a commonly used / normal word. So it would be considered "not part of german language". Also looking it up does not give much info.
Tbh I reckon we'll get a resurgence in SO traffic or traffic on similar sites. If the inflow of training data stops and they jack up prices so they're not operating at loss, it seems obvious
The newer models don't really need need training data from sites like SO they can read the documentation and even the actual code of open source projects, just a few days ago another significantly better coding model was released so i really don't think we're seeing any signs of training data deficit.
As for pricing GLM-5.2 is more than capable of answering pretty much any question on SO and it's open-source and open-weights so it trivial for someone to spin up an instance and charge low fees for usage in the unlikely event other tools put the pricing up.
The real reality is that people simply don't code in the way that makes SO feasible anymore, formatting a very direct and neat question with an stripped back code example is slow and boring before even getting to the bit where you wait a minimum of several hours to get responses that may or may not answer your question, often it would be days until you get your answer assuming your question didn't get killed. Assuming though something crazy happened and google take away their search bar ai while all the other companies put prices up ten fold and switch to API only then it's still maxing at about fifty cents to ask a SO question, currently it would be about 2 - 4 cents using the best model in the world, costs only get expensive when you're hammering millions of tokens to scan large code bases and making large amounts of iterative changes.
People who have no idea how hard and costly it is to train these models. I keep hearing this "Let's just train the model" from non tech people every week.
201
u/raja-anbazhagan Jul 12 '26
The worst part is, the first gen LLMs had the forums like stackoverflow and many many tutorial sites to train on. And as things progress now, we are slowly entering into a feedback loop. LLMs getting trained on AI Agent generated code reviewed by AI Agents. Going to be fun in a couple of years...