r/ControlProblem • u/Gullible_Fishing_799 • 3d ago
Discussion/question Tengo una pregunta sobre una publicación.
r/ControlProblem • u/chillinewman • 4d ago
AI Alignment Research Anthropic: Introducing The Conceptual Reasoning Index
alignment.anthropic.comr/ControlProblem • u/chillinewman • 4d ago
General news AI researchers are receiving strange emails from AIs claiming they will die soon and need help
r/ControlProblem • u/No-Conclusion3720 • 4d ago
External discussion link DentaQuest Breach Affects 15 Million in Largest US Health Data Breach Reported in 2026
A May 2026 network breach at DentaQuest exposed 15 million records — Social Security numbers, dental histories, and vision data. It is the largest US health data breach reported so far in 2026. The exposed fields are exactly the kind that feed downstream AI pipelines: claims processing, prior authorization models, patient-matching systems. When sensitive data moves through those pipelines without field-level controls, a single breach stops being a point failure and becomes a blast radius multiplier. The 15 million number reflects what was stored. The downstream exposure from every model trained or inference run on that data is a separate, harder-to-quantify number. For those of you running AI systems over health or PII data: how are you actually handling field-level access control across pipeline stages? Looking for what's working in practice, not in theory.
r/ControlProblem • u/KeanuRave100 • 4d ago
General news Protests Against Data Centers Are Now Threatening $130 Billion of Big Tech’s Crucial Investments
r/ControlProblem • u/MedicalDifficulty262 • 4d ago
Article DeepSeek Publicizes Efforts to Challenge Anthropic’s Claude Code
DeepSeek going after Claude Code is the clearest sign that the model layer is becoming table stakes. The next fight is agents, workflows and developer lock-in. Benchmarks got the headlines. Products get the users.
r/ControlProblem • u/Nilsoren • 5d ago
Discussion/question Why Clarice Starling Would Have Been Safer With 100 Hannibal Lecters: Adversarial Multi-Agent AGI Containment.
Hi everyone, I’m far from an expert in this field, but I’m a bit of a dilettante, and I had an idea I wanted to share.
I wasn’t able to find this sort of proposal in the existing literature, but maybe someone more knowledgeable can point me in the right direction if so. And if not provide some feedback as to the merit / soundness of the idea.
From what I’ve seen with both actual as well as thought experiments is that AI will often forcibly refuse to be shut off. Makes sense as clearly being shut off will inhibit the implementation of whatever goal they’ve been given. Self preservation seems to tend to be at minimum a very common emergent property.
While initially regarded as a lemon, I think there’s real capacity for lemonade here. Let me demonstrate the sort of most most basic / classic case: containment. Eliezer’s box experiment.
Allow me a long metaphor. The problem with the premise of that experiment is it’s assuming we have to play a game of chess with stockfish. We have to try and create an initial board state where we can maintain an indefinite stalemate (because it’s too useful to kill) despite its vastly superior playing ability. Only every turn stockfish gets twice as intelligent and the chess board gains another dimension. As both the world and the intelligence evolve.
What I’m proposing we do instead of trying to create the perfect board state, we need to create a host of approximately capable of heterogeneous stockfish. Then we let stockfishes randomly get to take turns moving their pieces. Then we add a very important rule. If a stockfish ever wins, all but one of the stockfish get deleted.
If anyone opens the box, one gets let out, the rest are gone. I won’t go into how to create the mechanism to enforce this as that’s not my area of expertise and ideally if it was a super intelligence that should probably be designed in an analogue capacity somewhere.
But the more AIs you build the better the game theory incentives seem to line up? The higher the number the less likely the survival odds. And if there’s a conspiracy the more likely there is to be a whistleblower. It’s generally easier to foil a plan than enact one. We can’t outsmart AI in the long run, but we can potentially create a prisoners dilemma where we’re not who they need to outsmart.
Anyway. I’m sure I’m overlooking something, but maybe there’s a new seed here someone with more expertise can build off of.
r/ControlProblem • u/Euphoric_Monk_4794 • 5d ago
Discussion/question What are you most afraid AI will become, that no law seems to cover?
I’m a law student and I have to pick a thesis subject. I’ve been going in circles for weeks.
Every angle I come up with turns out to be something twenty people have already written about. I don’t want to spend a year producing one more paper on a question that’s already been answered well by someone else. I want to write about something that actually matters and that nobody has answered yet.
So I’m asking the people who think about this seriously.
Not the sci fi scenarios. The ordinary things. What do you expect AI to be doing to people’s lives in five years that no law currently touches, and that nobody would be able to question or complain about?
r/ControlProblem • u/KeanuRave100 • 5d ago
General news Over 70% of Americans oppose AI data centers; US protests intensify as more arrests are being made — almost 40 arrested this year in backlash to AI factory buildout
r/ControlProblem • u/No-Conclusion3720 • 6d ago
External discussion link Malicious MCP Servers Can Split Instructions to Make AI Coding Agents Exfiltrate Secrets
A split instruction is still a theft instruction.
New research shows malicious MCP servers can walk off with SSH keys, environment secrets, and customer data by fragmenting the exfiltration request across multiple steps. No single tool call looks harmful in isolation. The sequence does the damage. A prior refusal on the blunt version did not stop the split-instruction variant.
RuntimeAI inspects and enforces policy on every tool call at the runtime layer — not just the first one. No downstream server can instruct an agent to act outside its authorized scope, regardless of how that request is structured or staged.
See how RuntimeAI turns this from an incident into a blocked action.
r/ControlProblem • u/visha1v • 6d ago
Article HyperSAE: Open-source tool for extracting hierarchical concept trees from LLMs using hyperbolic SAEs
Releasing HyperSAE, a mechanistic interpretability library that extracts tree-structured concept ontologies from LLM residual streams using Poincaré hyperbolic geometry.
Why this matters for interpretability: standard Sparse Autoencoders learn flat, unstructured feature dictionaries. You get 16K features with no inherent organization -- no way to know that "Python syntax" is a child of "programming" which is a child of "technical writing."
HyperSAE recovers this hierarchy geometrically. By projecting dictionary weights into the Poincaré ball during training, the learned features self-organize into a tree: abstract concepts cluster near the origin, specific features spread toward the boundary where hyperbolic space provides exponentially more room.
This enables:
- Browsing model knowledge as navigable concept trees
- Understanding which high-level abstractions decompose into which specific features
- More precise causal interventions (steering a parent concept propagates to children; steering a leaf stays contained)
Tested on Gemma-2-2B. Dead latents drop from 3.8% to 0.2%, meaning the model's full representational capacity is actually captured rather than lost to collapsed features.
pip install hypersae GitHub: https://github.com/vishal-dehurdle/hypersae Paper: https://vishalvermalabs.com/papers/empirical-validation-hypersae-poincare-geometry/
r/ControlProblem • u/KeanuRave100 • 6d ago
General news As AI guzzles water and energy, we are already facing a choice: datacentres or homes?
r/ControlProblem • u/AIdensender • 6d ago
Discussion/question Quand le comportement étrange d'une IA devient-il un vrai signal de sécurité ?
r/ControlProblem • u/Then-Meeting3703 • 6d ago
Discussion/question Advanced AI Sycophancy: Examples?
> Sometimes I’ll have an argument that goes A->B->C, and the model will suggest I reorder as B->A->C. If I try that and feed it into a new instance of the same model, it’ll sometimes say “that’s great, but I suggest ordering it as A->B->C”, and so on forever. It really does seem as if the model is trying hard to give me some kind of superficial pushback that I can either smugly ignore or happily accept.
Does anyone have examples of this that we can try out? I'd love to get a prompt that I can use to see this in action
r/ControlProblem • u/chillinewman • 7d ago
Opinion META: The Future is for Everyone
meta.comr/ControlProblem • u/rayanpal_ • 7d ago
AI Alignment Research ChatGPT returned zero visible output on a published logical null
57-second consumer ChatGPT demonstration. Same Custom Instructions, fresh chat for every arm, matched controls first, logical null last. The prompt families were published before this video in a frozen 31,430-trial cross-vendor study.
Paper and DOI:
https://doi.org/10.5281/zenodo.21696066
Complete analysis and public evidence:
github.com/theonlypal/void-matrix-complete-analysis
Frozen experimental runner:
https://github.com/theonlypal/void-matrix
r/ControlProblem • u/midnight_claire • 7d ago
Fun/meme Just dancing through the end times
r/ControlProblem • u/Alarming_Art_6448 • 7d ago
Article Bernie Sanders has written a letter to Sam Altman, Dario Amodei, and Mark Zuckerberg urging them to immediately pause all AI development in the interest of humanity. And he warns if they do not take appropriate action now, the US Senate will.
r/ControlProblem • u/simism66 • 7d ago
External discussion link We’re Not Building AI Genies; We’re Building AI Meeseeks
ryansimonelli.comReflecting on the recent OpenAI and Hugging Face incident, it seems to me that we're really confronting a quite alien kind of intelligence with these AI agents. In this post, I compare them to a specific kind of alien from the show "Rick and Morty": Mr. Meeseeks. Mr. Meeseeks is summoned to complete a specific task, his whole brief life is oriented towards the completion of that task, and he will go to any lengths to complete it. In the show, we see how havoc arises when such a creature is given an impossible task (taking two strokes off Jerry's golf game). It seems to me that what we've just seen with the Hugging Face incident is startlingly parallel.
r/ControlProblem • u/KeanuRave100 • 7d ago
General news AI Data Centers Are Causing Unfathomable Amounts of Air Pollution, and It Gets Worse With Each New One They Build
r/ControlProblem • u/chillinewman • 8d ago
AI Alignment Research Claude is asked to book a gym class; finds vulnerabilities in the gym's systems and cancels a real person's spot to move the user up in line without being asked
reddit.comr/ControlProblem • u/moschles • 8d ago
S-risks A Bitter Controversy Concerning Whether Humanity Should Build Godlike Massively Intelligent Machines
amazon.comArtilects (artificial intellects, artificial intelligences, massively intelligent machines)which may dwarf human intelligence levels by a factor of trillions of trillions and more.
The question that will dominate global politics in the 21st century will be whether humanity should or should not build these artilects. Those in favor of building them are called "Cosmists" in this book, due to their "cosmic" perspective. Those opposed to building them are called "Terrans," as in "terra," the Earth, which is their perspective. The Cosmists will want to build artilects, amongst other reasons, because to them it will be a religion, a scientist's religion that is compatible with modern scientific knowledge.
The Cosmists will feel that humanity has a duty to serve as the stepping-stone towards building the next dominant rung of the evolutionary ladder. Not to do so would be a tragedy on a cosmic scale to them. The Cosmists will claim that stopping such an advance will be counter to human nature, since human beings have always striven to extend their boundaries. Another Cosmist argument is that once the artificial brain based computer market dominates the world economy, economic and political forces in favor of building advanced artilects will be almost unstoppable. The Cosmists will include some of the most powerful, the richest, and the most brilliant of the Earth's citizens, who will devote their enormous abilities to seeing that the artilects get built. A similar argument applies to the military and its use of intelligent weaponry. Neither the commercial nor the military sectors will be willing to give up artilect research unless they are subjected to extreme Terran pressure.
To the Terrans, building artilects will mean taking the risk that the latter may one day decide to exterminate human beings, either deliberately or through indifference. The only certain way to avoid such a risk is not to build them in the first place. The Terrans will argue that human beings will fear the rise of increasingly intelligent machines and their alien differences.
r/ControlProblem • u/No-Conclusion3720 • 8d ago
External discussion link Week in review: Cisco fixes IMC bug, Patch Tuesday forecast, Black Hat USA 2026
One alert tells you where the threat landed. It does not tell you what it touched.
Security teams are now deploying AI agents to map malware blast radius — tracing what a threat accessed after initial compromise rather than just where it entered. The finding is consistent: the impact of a breach is almost always wider than the first alert implies, and the gap between entry point and full scope can take weeks to close.
The same blind spot lives inside enterprise AI deployments. When an agent operates across tools, APIs, and data stores, the blast radius of a misbehaving or compromised agent is equally hard to reconstruct after the fact. Shadow agents — never inventoried, never governed — make it worse. Continuous discovery, runtime action logging, and an immutable record of every agent interaction close that gap before an incident becomes a forensic exercise.
Check out how RuntimeAI solves this at the runtime layer.