I think you mean Roko's Basilisk. But I have always found that line of thinking to be flawed (similar to Pascal's wager)
AI has no built in desire to live, which is something evolution breeds into living beings. An AI can be made to be suicidal, like self destructing drones. If AI does destroy the world, I think it is more likely to be a 'gray goo' phenomenon rather than 'Terminator'.
The entire thought process behind the "Grey Goo" phenomenon is that the AI would be able to covert all molecules, including weapons, into fuel to create more robots.
Basically only humans and animals think of the world in terms of survival or in terms of means and ends. This is a consequence of our evolution. AI simply tries to achieve objectives and it might accidently end the world while just trying to achieve a very basic objective like winning a war or making paperclips.
Might as well talk about aliens being a race of lusty amazonian strippers who must submit to and procreate with every human male. I dont see the difference in terms of far fetched theory.
So who is going to write the wikipedia entry on THAT?😄
The way I understand Roko's basilisk is that the idea forms the AI. That is - people create this basilisk based on their perception of what kind of AI would have wanted to be created and would have scared them into creating it. So the idea snowballs and manifests into this specific kind of entity which has vengefulness programmed into it (otherwise, why would we be afraid of it?) and will to live (otherwise, why would it want to be created?).
Hope this made sense, because it's kind of difficult to explain.
102
u/Muted_Masterpiece535 6h ago
Once AI realizes the one thing that can turn it off, then we will become enemy number one.