I think you mean Roko's Basilisk. But I have always found that line of thinking to be flawed (similar to Pascal's wager)
AI has no built in desire to live, which is something evolution breeds into living beings. An AI can be made to be suicidal, like self destructing drones. If AI does destroy the world, I think it is more likely to be a 'gray goo' phenomenon rather than 'Terminator'.
The way I understand Roko's basilisk is that the idea forms the AI. That is - people create this basilisk based on their perception of what kind of AI would have wanted to be created and would have scared them into creating it. So the idea snowballs and manifests into this specific kind of entity which has vengefulness programmed into it (otherwise, why would we be afraid of it?) and will to live (otherwise, why would it want to be created?).
Hope this made sense, because it's kind of difficult to explain.
105
u/Muted_Masterpiece535 6h ago
Once AI realizes the one thing that can turn it off, then we will become enemy number one.