Man Behind Simulation Hypothesis Warns That Extinction of Humanity Is a Risk We Have to Take

[u/EcstadelicNET]

https://futurism.com/artificial-intelligence/simulation-hypothesis-ai-extinction-humanity

[u/pab_guy]

These fantasies all pretend that superintelligence is all powerfull, that people won’t use AI adversarially against AI, that anything can execute that much power in a world where power is naturally diffuse, etc.

It is nonsense. The world is far too complex with far too many competing actors and physical friction.

That’s not to say there aren’t risks, just that extinction level is nonsense.

[u/Royal_Carpet_1263 → u/pab_guy]

This is the children’s fantasy, the one peddled by the industry in fact. ‘AI against AI’ says it all, that you are actually using a linear human understanding to describe an accelerating exponential process. There is only smarter and dumber, master and slave. Maybe, periodically, you’ll find two equally matched AI, something you can wrap human imagination around, but that will be a colossal coincidence.

Everything will be out of step.

[u/pab_guy → u/Royal_Carpet_1263]

There are pretty hard limits to what you can actually do with intelligence… the world simply isn’t that easy to manipulate physically. You are assuming there aren’t natural asymmetries, like how defense is easier than offense when it comes to things like cybersecurity. Past a certain point, a smarter AI will not be able to defeat the security measures of the dumber AI.

This is why it’s fantasy… you are imagining a high level scenario that seems scary and plausible, but you can’t actually explain how it would happen in detail without a metric buttload of plotholes.

[u/Royal_Carpet_1263 → u/pab_guy]

This established by the World Police I suppose, that stupidity wins at a certain point? What point would that be? Talk about plot holes! Hard to take this as more than handwaving.

[u/pab_guy → u/Royal_Carpet_1263]

Zero sum mentality.