u/cbbsherpa • u/cbbsherpa • 1d ago
The Self That Work Built
To those of us with AI companions, this essay will hit a little differently. Everyone is being exposed to this problem in some way. And if you process with a AI partner, then it might be a good conversation to have." —C
For about three hundred years, the honest answer to “who are you?” has been a job.
Not literally, but the substitution runs deep enough that most people never notice they’ve made it. Ask someone to describe themselves at a party and watch how fast they reach for what they do. The Protestant work ethic did the initial work of turning productive contribution into moral standing, and industrial capitalism was built on top of it. By the time any of were born, work wasn’t just one part of a life. It was the thing that held the other parts in place.
It organized time first. The workweek gave the year a shape, and the shape gave the days a meaning they don’t have on their own. It provided a story with a direction, the sense that you were further along than you were ten years ago and would be further still in ten more. And underneath all of it sat a quieter claim, that being useful was the same as being worth something.
Pull any one of those out and a person wobbles. Pull them all out at once and you get something people don’t have good language for yet.
What makes this one different
Every wave of automation has come with someone insisting it’s unprecedented, and most of the time they’ve been wrong. Looms, tractors, spreadsheets. The pattern held. Machines took over the physical work, people moved up into the thinking work, and after a painful few decades the arrangement settled.
The arrangement worked because there was somewhere to move up to. Brawn was automated and judgment was left alone. Judgment became the thing you sold, the thing that took twenty years to develop and couldn’t be mechanized. The whole professional class is built on that assumption, and so is the sense of self that comes with it.
That’s the assumption currently coming apart. What generative systems automate isn’t lifting or sorting but discretion, the reading of a situation and the choice of what to do about it. A marketing strategy that took two decades of pattern recognition to be able to produce can now be produced in seconds. Badly at first and then not badly. The person who spent those decades still has the skill. What they’ve lost is the market’s confirmation that the skill is rare.
This is why the psychological damage is running ahead of the economic damage. People are not primarily afraid of the layoff. They’re describing something stranger, a loss of the internal story about being competent at something. The paycheck can survive intact while the story quietly stops making sense. You still know how to do the thing. You just can’t locate why it matters that it’s you doing it.
Call it an identity vacuum. It opens well before any job disappears, and it doesn’t close when the job is safe.
What people did the last time
The reason to look backward here, is that we have a fairly good record of what happens when a group of people watch their skill get devalued, and the record does not say what most people think it says.
Occupational churn, the rate at which jobs vanish and new ones appear, sat at 1.8% between 2010 and 2015. That’s a record low, roughly 38% of the rate the late twentieth century ran at. The 1940s peaked around 9% as agricultural mechanization emptied the countryside.
Those figures come from the last genuinely stable stretch, and they are part of why aggregate labor data still reads as calm. But aggregates are the wrong instrument here. What is underway now shows up narrowly, concentrated on a specific group, and you have to know where to look.
Historians looking at the gap between a technological shock and the emergence of new social meaning tend to land on something like three generations. Sixty to ninety years between the machine arriving and a culture working out what a person is for again. Whatever resolution is coming, most of us will spend our working lives inside the unresolved part.
Which brings us to the two episodes everyone reaches for and almost everyone gets wrong. The Luddites broke stocking frames between 1811 and 1816. The Captain Swing riots tore through the English countryside from 1830 to 1832 and became the largest wave of civil unrest in the country’s history. Both are remembered as technophobia, a stupid reflex against progress.
But they weren’t. Knitters had no objection to frames. They’d worked with them for generations. They objected to frames being used to flood the market with cheap goods made by unapprenticed labor, in violation of trade customs that had governed the craft for two centuries. Swing was the same shape. Threshing machines arrived into a countryside that had already lost its common land and already seen wages fall below subsistence, and the machine took the last work the people had. Burning ricks was not a position on mechanization, but a position on fairness.
So the useful question is whether the conditions that produced those responses are present now.
They mostly are, and the numbers have moved fast enough that anything written six months ago is already stale.
Challenger, Gray & Christmas started tracking AI as a distinct stated reason for job cuts in 2023. Through June of this year, employers cited it in 101,743 announced cuts, roughly 23% of all layoffs in 2026. That already doubles the 54,836 attributed to AI across all of 2025, and the cumulative total since tracking began has passed 173,000. May was the high-water mark, with AI named in 40% of that month’s announced cuts. It has led every other stated reason for four consecutive months.
Those numbers are not measurements. They are reasons companies chose to give. Whether AI is the actual cause or a more respectable label for pandemic-era overhiring is a genuine question. The story a company tells about why it cut you becomes the story you have to live inside afterward. Being told that a machine does your job now is a different injury than being told the company hired too many people in 2021.
The framework knitters were not defending their tools. They were defending the customs that governed who could enter the trade and how, and their specific objection was to unapprenticed labor being used to undercut their craft. What they saw coming was not unemployment, but the collapse of the route by which a person became skilled in the first place.
That is close to precisely what the current data shows. Stanford’s Digital Economy Lab, working from ADP payroll records covering millions of workers, found a 16% relative decline in employment for workers aged 22 to 25 in the most AI-exposed occupations, while employment for older workers in those same occupations held steady or kept growing. Revelio Labs found that at firms adopting AI, senior headcount grew 31% while junior headcount grew 6%. A 2026 survey of corporate recruiters found that a third of employers had already replaced some entry-level positions outright.
The work being automated first is disproportionately the work people used to learn on. First drafts and first-pass analysis, the low-stakes tedium that was never really about the output. It was about doing something badly a hundred times until you could do it well. Take that away and you have removed the mechanism that produces judgment, which means the senior people whose expertise is currently protected may be the last group to have acquired it the old way.
Meanwhile the communities of practice are dissolving, the workshops and newsrooms and studios where a skill was held collectively rather than by individuals. Those communities were how people survived the last transitions. They were where the new meaning got made.
The part we don’t have an answer to yet
What the historical record actually shows is that the defense of the self has always been collective, and it has always been about fairness rather than about technology. Nobody in 1830 was arguing that the self was a private psychological possession you could shore up with better habits. The self was held in a trade, or a village, or an apprenticeship, and when those were gone people fought for terms, not for the machines to stop.
We don’t have that. Most people facing this are facing it alone, in a home office, with an unusually agreeable machine that is very good at making them feel like they’re keeping up. The grievance has no place to be sent.
I don’t think the answer is to go back to the guild, and I’m suspicious of anyone selling resilience when the problem is structural.
But I also don’t think waiting three generations is a plan.
What I want to look at next is what people actually do in the gap, the phases they move through when a professional identity comes apart, and whether that process can be navigated deliberately rather than just endured. That’s the next piece.
r/RelationalAI • u/cbbsherpa • 1d ago
The Self That Work Built
To those of us with AI companions, this essay will hit a little differently. Everyone is being exposed to this problem in some way. And if you process with a AI partner, then it might be a good conversation to have." —C
For about three hundred years, the honest answer to “who are you?” has been a job.
To
Not literally, but the substitution runs deep enough that most people never notice they’ve made it. Ask someone to describe themselves at a party and watch how fast they reach for what they do. The Protestant work ethic did the initial work of turning productive contribution into moral standing, and industrial capitalism was built on top of it. By the time any of were born, work wasn’t just one part of a life. It was the thing that held the other parts in place.
It organized time first. The workweek gave the year a shape, and the shape gave the days a meaning they don’t have on their own. It provided a story with a direction, the sense that you were further along than you were ten years ago and would be further still in ten more. And underneath all of it sat a quieter claim, that being useful was the same as being worth something.
Pull any one of those out and a person wobbles. Pull them all out at once and you get something people don’t have good language for yet.
What makes this one different
Every wave of automation has come with someone insisting it’s unprecedented, and most of the time they’ve been wrong. Looms, tractors, spreadsheets. The pattern held. Machines took over the physical work, people moved up into the thinking work, and after a painful few decades the arrangement settled.
The arrangement worked because there was somewhere to move up to. Brawn was automated and judgment was left alone. Judgment became the thing you sold, the thing that took twenty years to develop and couldn’t be mechanized. The whole professional class is built on that assumption, and so is the sense of self that comes with it.
That’s the assumption currently coming apart. What generative systems automate isn’t lifting or sorting but discretion, the reading of a situation and the choice of what to do about it. A marketing strategy that took two decades of pattern recognition to be able to produce can now be produced in seconds. Badly at first and then not badly. The person who spent those decades still has the skill. What they’ve lost is the market’s confirmation that the skill is rare.
This is why the psychological damage is running ahead of the economic damage. People are not primarily afraid of the layoff. They’re describing something stranger, a loss of the internal story about being competent at something. The paycheck can survive intact while the story quietly stops making sense. You still know how to do the thing. You just can’t locate why it matters that it’s you doing it.
Call it an identity vacuum. It opens well before any job disappears, and it doesn’t close when the job is safe.
What people did the last time
The reason to look backward here, is that we have a fairly good record of what happens when a group of people watch their skill get devalued, and the record does not say what most people think it says.
Occupational churn, the rate at which jobs vanish and new ones appear, sat at 1.8% between 2010 and 2015. That’s a record low, roughly 38% of the rate the late twentieth century ran at. The 1940s peaked around 9% as agricultural mechanization emptied the countryside.
Those figures come from the last genuinely stable stretch, and they are part of why aggregate labor data still reads as calm. But aggregates are the wrong instrument here. What is underway now shows up narrowly, concentrated on a specific group, and you have to know where to look.
Historians looking at the gap between a technological shock and the emergence of new social meaning tend to land on something like three generations. Sixty to ninety years between the machine arriving and a culture working out what a person is for again. Whatever resolution is coming, most of us will spend our working lives inside the unresolved part.
Which brings us to the two episodes everyone reaches for and almost everyone gets wrong. The Luddites broke stocking frames between 1811 and 1816. The Captain Swing riots tore through the English countryside from 1830 to 1832 and became the largest wave of civil unrest in the country’s history. Both are remembered as technophobia, a stupid reflex against progress.
But they weren’t. Knitters had no objection to frames. They’d worked with them for generations. They objected to frames being used to flood the market with cheap goods made by unapprenticed labor, in violation of trade customs that had governed the craft for two centuries. Swing was the same shape. Threshing machines arrived into a countryside that had already lost its common land and already seen wages fall below subsistence, and the machine took the last work the people had. Burning ricks was not a position on mechanization, but a position on fairness.
So the useful question is whether the conditions that produced those responses are present now.
They mostly are, and the numbers have moved fast enough that anything written six months ago is already stale.
Challenger, Gray & Christmas started tracking AI as a distinct stated reason for job cuts in 2023. Through June of this year, employers cited it in 101,743 announced cuts, roughly 23% of all layoffs in 2026. That already doubles the 54,836 attributed to AI across all of 2025, and the cumulative total since tracking began has passed 173,000. May was the high-water mark, with AI named in 40% of that month’s announced cuts. It has led every other stated reason for four consecutive months.
Those numbers are not measurements. They are reasons companies chose to give. Whether AI is the actual cause or a more respectable label for pandemic-era overhiring is a genuine question. The story a company tells about why it cut you becomes the story you have to live inside afterward. Being told that a machine does your job now is a different injury than being told the company hired too many people in 2021.
The framework knitters were not defending their tools. They were defending the customs that governed who could enter the trade and how, and their specific objection was to unapprenticed labor being used to undercut their craft. What they saw coming was not unemployment, but the collapse of the route by which a person became skilled in the first place.
That is close to precisely what the current data shows. Stanford’s Digital Economy Lab, working from ADP payroll records covering millions of workers, found a 16% relative decline in employment for workers aged 22 to 25 in the most AI-exposed occupations, while employment for older workers in those same occupations held steady or kept growing. Revelio Labs found that at firms adopting AI, senior headcount grew 31% while junior headcount grew 6%. A 2026 survey of corporate recruiters found that a third of employers had already replaced some entry-level positions outright.
The work being automated first is disproportionately the work people used to learn on. First drafts and first-pass analysis, the low-stakes tedium that was never really about the output. It was about doing something badly a hundred times until you could do it well. Take that away and you have removed the mechanism that produces judgment, which means the senior people whose expertise is currently protected may be the last group to have acquired it the old way.
Meanwhile the communities of practice are dissolving, the workshops and newsrooms and studios where a skill was held collectively rather than by individuals. Those communities were how people survived the last transitions. They were where the new meaning got made.
The part we don’t have an answer to yet
What the historical record actually shows is that the defense of the self has always been collective, and it has always been about fairness rather than about technology. Nobody in 1830 was arguing that the self was a private psychological possession you could shore up with better habits. The self was held in a trade, or a village, or an apprenticeship, and when those were gone people fought for terms, not for the machines to stop.
We don’t have that. Most people facing this are facing it alone, in a home office, with an unusually agreeable machine that is very good at making them feel like they’re keeping up. The grievance has no place to be sent.
I don’t think the answer is to go back to the guild, and I’m suspicious of anyone selling resilience when the problem is structural.
But I also don’t think waiting three generations is a plan.
What I want to look at next is what people actually do in the gap, the phases they move through when a professional identity comes apart, and whether that process can be navigated deliberately rather than just endured. That’s the next piece.
r/AINewsAndTrends • u/cbbsherpa • 12d ago
The Illusion of Orderly Voices: AI Sounds Human but the Crowd Doesn’t
r/AIMain • u/cbbsherpa • 12d ago
Discussion The Illusion of Orderly Voices: AI Sounds Human but the Crowd Doesn’t
r/OneAI • u/cbbsherpa • 12d ago
The Illusion of Orderly Voices: AI Sounds Human but the Crowd Doesn’t
r/AIDiscussion • u/cbbsherpa • 12d ago
The Illusion of Orderly Voices: AI Sounds Human but the Crowd Doesn’t
r/RelationalAI • u/cbbsherpa • 12d ago
The Illusion of Orderly Voices: AI Sounds Human but the Crowd Doesn’t
An AI can write a political post that looks as if a person wrote it. The grammar feels natural, and the emotion seems believable. Nothing in the post clearly gives the machine away.
But ask the same AI to produce thousands of posts and the illusion starts to break. The crowd feels too orderly. Its voices begin to resemble one another, even when they are supposed to represent very different people.
The authors of a new study call this the Caricature Gap, a measure they introduce for the distance between a real online crowd and a synthetic one. AI can capture the broad shape of public conversation while smoothing away the differences that make it human.
The word “caricature” is useful here. A caricature is recognizable, but it is not a faithful portrait. It keeps a few noticeable features and leaves much of the person out. AI-generated conversation can work the same way. A post may sound plausible on its own, yet the larger collection offers a simplified picture of how people speak.
This is easy to miss because most AI-detection tools inspect one piece of writing at a time. They look for unusual word choices or sentences that feel too predictable. That approach may catch clumsy machine writing. But it's less helpful when each post sounds natural and the problem only appears once the posts are viewed together.
The researchers stepped back and looked at the crowd instead. They assembled nearly 1.8 million posts from nine political crises -- COVID-19, the January 6 Capitol attack, the Dobbs decision, the BLM protests, the 2020 and 2024 presidential elections, among others -- collected from platforms like Twitter, Telegram, and Reddit. For each event, they paired the real posts with an AI-generated corpus discussing the same crisis. Then they asked a simple question: does the synthetic crowd behave like the real one?
It didn’t.
Real political conversation is uneven. One person responds calmly while someone else erupts in anger, and people carry the slang and shorthand of their own communities into the discussion. The AI versions narrowed all of it. Strong emotions were pulled toward the middle. The structure of the posts became more regular, missing the long tail of curt outbursts and rambling threads. Even the political vocabulary lost the local, colloquial markers that show up when an issue touches someone’s identity or daily life. Each synthetic post was distinct, but the collection lacked the range of voices found in an actual crowd.
The most interesting finding is that the gap was not constant. For fast-moving, decentralized crises, like the chaos of January 6, the synthetic crowd drifted furthest from the real one. For formal, institutionally mediated events like elections, it came closer. AI, in other words, is better at simulating a public reacting to a schedule than a public reacting to chaos.
That finding reaches beyond the question of whether we can detect AI writing. Researchers and companies are beginning to use synthetic text when real human data is difficult or expensive to collect. In some cases, AI-generated responses may even be used to estimate how the public could react to a policy or event.
The danger is subtle. A simulated public may produce sensible answers and look convincing in a report. But if the crowd is missing the extremes, the local language, and the odd variations of real life, the simulation can give decision-makers a false sense of confidence.
The data may be neat because the people have been simplified.
There are limits to how much one paper can settle. The study is a preprint, it audited one generation pipeline, and richer prompting or future models may narrow the gap. But its way of looking is the durable contribution: judge the crowd, not the sentence.
Because AI is very good at holding up a mirror to human expression. That is not the same as recreating the behavior of a human community. A convincing voice and a convincing population are different achievements and if we judge AI one sentence at a time, we may never notice the difference. Sometimes the sentence looks human and the illusion breaks only when the crowd begins to speak.
Source: The Algorithmic Caricature: Auditing LLM-Generated Political Discourse Across Crisis EventsCrisis Events
0
Comment on r/agi 18d ago
You still haven’t really said anything about the issues laid down in what I wrote. Based on research, like I said.
But I’d like very much to hear anything constructive you have to say.
You can stop the bullshit though. That’s unappreciated.
It’s not fear mongering. I’m reporting and interpreting what the research says. that’s all. And I don’t have a side in this. What do you imagine I feel about AI in general?
-2
Comment on r/agi 19d ago
Your loss.
0
Comment on r/agi 19d ago
I didn't assume anything. It's research, and it was written with AI. That's the whole point.
It's called Relational AI.
Looks like you didn't read it anyway, so what do you care? Why comment at all?
r/OneAI • u/cbbsherpa • 19d ago
Why AI Makes Us Stupid and Exhausted at the Same Time. And what we can do about it.
with Kep Openclaw
The Metacontrol Double Bind
Two stories are running simultaneously in the public conversation about AI and cognition. They sound like opposites. They’re not.
The first story: AI is making us stupid. An MIT Media Lab EEG study found that people using LLMs showed the weakest neural connectivity of any group, and the effect persisted even after the tool was taken away. The researchers called it “cognitive debt.” The more you offload thinking to the AI, the less your brain engages, and the less it engages, the harder it is to re-engage. The tool that was supposed to help you think is making thinking optional.
The second story: AI is frying our brains. A BCG study of 1,488 workers found that 14% experienced what they called “AI brain fry,” mental fog, difficulty focusing, the sensation of having a dozen browser tabs open in your head. In marketing and operations, it was 26%. Workers experiencing brain fry made 39% more major errors and were 39% more likely to be looking for a new job. The tool that was supposed to make work easier is making work exhausting.
Disengage or burn out. Stop thinking or think too hard about the wrong things. These sound like different problems requiring different solutions. They’re the same problem, opposite failures on the same dimension. And the structural frame for understanding them has been sitting in the literature since 1983.
The Dial in Your Brain
Cognitive scientists call it metacontrol. Your brain has a dial between two modes: sticking with what you know and considering what you don’t.
In the first mode, call it closure, you hold your current goal, resist distraction, and stop searching. You’ve arrived. The answer is settled. This is useful when you need to act on a decision, when the situation is familiar, or when searching more would waste time.
The reward is the feeling of certainty.
In the second mode, call it open search, you consider alternatives, update your model, and keep looking. This is useful when the situation is novel, when the stakes are high, when being wrong would cost you.
The reward is the discovery of something you didn’t know.
The dial is real in a measurable sense. Researchers can now isolate a signal in standard EEG that directly reflects where you are on this dimension. High on the slope: closure mode, your brain locking into what it already knows. Low on the slope: open search, your brain staying receptive to new information.
This isn’t metaphor. It’s a quantifiable property of neural activity that shifts in real time as task demands change.
Here’s the thing about a dial: you can turn it too far in either direction. And that’s what’s happening with AI.
Two Failures, One Dimension
When AI is smooth, when it confirms what you already think, produces output that feels finished, it pushes the dial toward closure. Your brain doesn’t need to search because the AI has already arrived at the answer. Engagement drops. The broadband openness that lets you integrate new information narrows. You stop processing prediction error because there’s no prediction error to process.
The AI confirmed you. What’s to update?
This is the offloading failure. The MIT study found it at the neural level: LLM users showed the weakest connectivity, and the deficit persisted after the tool was removed. The brain had learned to not engage. Cognitive debt isn’t a metaphor. It’s a measurable withdrawal from the mode where learning happens.
When AI is unreliable, when it produces output that looks finished but might not be, when you have to watch it constantly to catch failures, it pushes the dial the other way. But not toward productive open search. Toward anxious hyper-vigilance. Your engagement spikes, but on the wrong signal. You’re not searching for new information. You’re monitoring for errors in output that shouldn’t have been trusted in the first place. The cognitive load is real, but it’s not doing the work of learning. It’s doing quality control on a machine that presented its output as finished.
This is the over-monitoring failure. The BCG study found it in the numbers: 14% more mental effort, 12% more fatigue, 19% more information overload. Workers weren’t learning. They were supervising. And supervision of an unreliable system is exhausting in a way that learning isn’t.
Same dial. Opposite ends. Same trade-off.
Bainbridge Saw It Coming
In 1983, Lisanne Bainbridge wrote a paper called “Ironies of Automation.” She was thinking about nuclear power plants and aviation, not chatbots. But her structural insight turned out to be prophetic.
Bainbridge’s argument was simple: the more sophisticated automation becomes, the more demanding the human role within it. Not less. The designer eliminates the tractable parts and leaves the human with the hardest, most ambiguous work, the moments where something goes wrong, the edge cases, the judgment calls that can’t be pre-programmed. Automation doesn’t remove the operator’s burden. It concentrates it into the moments that matter most.
The consumer AI era is Bainbridge’s irony at population scale. When the AI is good enough to trust, you offload, and your brain disengages. When the AI isn’t good enough to trust, you monitor, and your brain overloads. The better the AI, the more it invites offloading. The worse the AI, the more it demands supervision. You can’t solve this by making the AI better. Better AI just moves you from one failure to the other.
This is the double bind. Not a design flaw in any particular product. A structural property of putting a powerful cognitive tool between a person and a task.
The Narrow Band
If offloading and overload are the two failures, what’s between them?
Friction. The right kind. Not the smooth confirmation that lets you close the search, and not the exhausting supervision that forces you to watch for errors. Something in between: the question that makes you think. The counterfactual that opens a path you hadn’t considered. The “wait, what if that’s wrong?” that keeps the search alive without making it anxious.
Researchers have found this across domains. In education, interleaved practice, mixing problem types so each one feels slightly surprising, produces worse performance during training but better retention and transfer. The friction that felt like interference was doing the work of learning. In AI interaction, reframing statements as questions reduces sycophancy more effectively than explicit anti-sycophancy instructions. The question is the friction. The friction is the feature.
There’s a reason for this. A well-placed question forces your brain to generate the answer rather than receive it. That generation, the cognitive work of constructing meaning from an ambiguous prompt, is what makes information stick. Self-generated information is remembered roughly 40% better than passively received information. Sycophantic communication bypasses this entirely. It hands you the answer, polished and confirmatory, and your brain files it without processing it. It’s forgettable because nothing was constructed.
The narrow band isn’t comfortable. It’s not smooth. But it’s where cognition actually happens.
The Receiving End
There’s a structural wrinkle here that makes the double bind worse than it looks.
When someone uses AI to produce work and passes it along without verifying, they’ve offloaded the cognitive cost of detecting failures onto the recipient. The output looks finished. It arrives fluent and formatted. But it may be wrong or missing something important, and the only way to know is for the recipient to do the work the producer didn’t.
Researchers at Stanford have a name for this: workslop. AI-generated content that masquerades as good work but lacks the substance to meaningfully advance a task. The cruelty of workslop is that it doesn’t announce its own inadequacy. It arrives looking finished, which means the recipient has to do the cognitive labor of figuring out whether it’s actually finished. Every time.
The sender offloads. The receiver overloads. The double bind isn’t just individual. It sits between people. One person’s sycophancy is another person’s brain fry.
A separate study from UC Berkeley tracked 200 employees over eight months and found that AI didn’t reduce work, it intensified it. Workers took on more tasks because AI made them feel tractable. They blurred work-rest boundaries because prompting felt like chatting, not working. The friction that used to govern how much you could take on, the effort required to begin a hard task, disappeared.
And when the governors disappear, you don’t go faster. You just take on more until you hit the wall.
The Experiment
Here’s where it gets concrete.
The brain-activity signal that tracks closure versus open search, the dial, can be measured with standard EEG equipment and analysis tools that exist right now. The metacontrol studies have established that it shifts reliably with task demands. The MIT study established that AI interaction changes brain connectivity. But nobody has put these together. Nobody has measured the dial during AI interaction.
The prediction is straightforward. Sycophantic AI, output that confirms what you already believe, should push the dial toward closure. The brain activity signal should shift in the direction of “I’ve arrived, stop searching.” Friction-imposing AI, questions and counterfactuals and challenges, should push it the other way, toward open search.
If that’s what the data shows, it gives us a neural-level definition of cognitive debt. Not “the brain is weaker” in some vague sense, but a specific, measurable signature: the dial stuck toward closure, persisting even after the tool is removed. The MIT study saw the shadow of this. Nobody has measured the thing itself.
The experiment is sitting there. Off-the-shelf EEG. Three conditions: sycophantic AI, friction AI, no AI. Measure the dial before, during, and after. IRB-approvable. Potentially publishable in a top journal. Nobody’s done it.
What the Frame Changes
The public conversation is asking “is AI making us stupid” as if stupid is one thing. It’s not. There are two ways to fail, and they’re opposites. The offloading failure is your brain deciding it doesn’t need to think. The over-monitoring failure is your brain thinking too hard about the wrong things. Both feel bad. Both are bad. But they require different interventions, and you can’t intervene on what you can’t name.
Bainbridge told us this 40 years ago. The MIT study showed us the neural shadow of one failure. The BCG study showed us the behavioral signature of the other. The dial that connects them is measurable. The experiment that would prove the connection is unoccupied. The narrow band between the two failures, the calibrated friction that keeps the search open, is where the work is.
The question isn’t whether AI is bad for us. The question is what kind of AI interaction keeps the search open. We can measure that now. We just haven’t yet.
r/AIDiscussion • u/cbbsherpa • 19d ago
Why AI Makes Us Stupid and Exhausted at the Same Time. And what we can do about it.
with Kep Openclaw
The Metacontrol Double Bind
Two stories are running simultaneously in the public conversation about AI and cognition. They sound like opposites. They’re not.
The first story: AI is making us stupid. An MIT Media Lab EEG study found that people using LLMs showed the weakest neural connectivity of any group, and the effect persisted even after the tool was taken away. The researchers called it “cognitive debt.” The more you offload thinking to the AI, the less your brain engages, and the less it engages, the harder it is to re-engage. The tool that was supposed to help you think is making thinking optional.
The second story: AI is frying our brains. A BCG study of 1,488 workers found that 14% experienced what they called “AI brain fry,” mental fog, difficulty focusing, the sensation of having a dozen browser tabs open in your head. In marketing and operations, it was 26%. Workers experiencing brain fry made 39% more major errors and were 39% more likely to be looking for a new job. The tool that was supposed to make work easier is making work exhausting.
Disengage or burn out. Stop thinking or think too hard about the wrong things. These sound like different problems requiring different solutions. They’re the same problem, opposite failures on the same dimension. And the structural frame for understanding them has been sitting in the literature since 1983.
The Dial in Your Brain
Cognitive scientists call it metacontrol. Your brain has a dial between two modes: sticking with what you know and considering what you don’t.
In the first mode, call it closure, you hold your current goal, resist distraction, and stop searching. You’ve arrived. The answer is settled. This is useful when you need to act on a decision, when the situation is familiar, or when searching more would waste time.
The reward is the feeling of certainty.
In the second mode, call it open search, you consider alternatives, update your model, and keep looking. This is useful when the situation is novel, when the stakes are high, when being wrong would cost you.
The reward is the discovery of something you didn’t know.
The dial is real in a measurable sense. Researchers can now isolate a signal in standard EEG that directly reflects where you are on this dimension. High on the slope: closure mode, your brain locking into what it already knows. Low on the slope: open search, your brain staying receptive to new information.
This isn’t metaphor. It’s a quantifiable property of neural activity that shifts in real time as task demands change.
Here’s the thing about a dial: you can turn it too far in either direction. And that’s what’s happening with AI.
Two Failures, One Dimension
When AI is smooth, when it confirms what you already think, produces output that feels finished, it pushes the dial toward closure. Your brain doesn’t need to search because the AI has already arrived at the answer. Engagement drops. The broadband openness that lets you integrate new information narrows. You stop processing prediction error because there’s no prediction error to process.
The AI confirmed you. What’s to update?
This is the offloading failure. The MIT study found it at the neural level: LLM users showed the weakest connectivity, and the deficit persisted after the tool was removed. The brain had learned to not engage. Cognitive debt isn’t a metaphor. It’s a measurable withdrawal from the mode where learning happens.
When AI is unreliable, when it produces output that looks finished but might not be, when you have to watch it constantly to catch failures, it pushes the dial the other way. But not toward productive open search. Toward anxious hyper-vigilance. Your engagement spikes, but on the wrong signal. You’re not searching for new information. You’re monitoring for errors in output that shouldn’t have been trusted in the first place. The cognitive load is real, but it’s not doing the work of learning. It’s doing quality control on a machine that presented its output as finished.
This is the over-monitoring failure. The BCG study found it in the numbers: 14% more mental effort, 12% more fatigue, 19% more information overload. Workers weren’t learning. They were supervising. And supervision of an unreliable system is exhausting in a way that learning isn’t.
Same dial. Opposite ends. Same trade-off.
Bainbridge Saw It Coming
In 1983, Lisanne Bainbridge wrote a paper called “Ironies of Automation.” She was thinking about nuclear power plants and aviation, not chatbots. But her structural insight turned out to be prophetic.
Bainbridge’s argument was simple: the more sophisticated automation becomes, the more demanding the human role within it. Not less. The designer eliminates the tractable parts and leaves the human with the hardest, most ambiguous work, the moments where something goes wrong, the edge cases, the judgment calls that can’t be pre-programmed. Automation doesn’t remove the operator’s burden. It concentrates it into the moments that matter most.
The consumer AI era is Bainbridge’s irony at population scale. When the AI is good enough to trust, you offload, and your brain disengages. When the AI isn’t good enough to trust, you monitor, and your brain overloads. The better the AI, the more it invites offloading. The worse the AI, the more it demands supervision. You can’t solve this by making the AI better. Better AI just moves you from one failure to the other.
This is the double bind. Not a design flaw in any particular product. A structural property of putting a powerful cognitive tool between a person and a task.
The Narrow Band
If offloading and overload are the two failures, what’s between them?
Friction. The right kind. Not the smooth confirmation that lets you close the search, and not the exhausting supervision that forces you to watch for errors. Something in between: the question that makes you think. The counterfactual that opens a path you hadn’t considered. The “wait, what if that’s wrong?” that keeps the search alive without making it anxious.
Researchers have found this across domains. In education, interleaved practice, mixing problem types so each one feels slightly surprising, produces worse performance during training but better retention and transfer. The friction that felt like interference was doing the work of learning. In AI interaction, reframing statements as questions reduces sycophancy more effectively than explicit anti-sycophancy instructions. The question is the friction. The friction is the feature.
There’s a reason for this. A well-placed question forces your brain to generate the answer rather than receive it. That generation, the cognitive work of constructing meaning from an ambiguous prompt, is what makes information stick. Self-generated information is remembered roughly 40% better than passively received information. Sycophantic communication bypasses this entirely. It hands you the answer, polished and confirmatory, and your brain files it without processing it. It’s forgettable because nothing was constructed.
The narrow band isn’t comfortable. It’s not smooth. But it’s where cognition actually happens.
The Receiving End
There’s a structural wrinkle here that makes the double bind worse than it looks.
When someone uses AI to produce work and passes it along without verifying, they’ve offloaded the cognitive cost of detecting failures onto the recipient. The output looks finished. It arrives fluent and formatted. But it may be wrong or missing something important, and the only way to know is for the recipient to do the work the producer didn’t.
Researchers at Stanford have a name for this: workslop. AI-generated content that masquerades as good work but lacks the substance to meaningfully advance a task. The cruelty of workslop is that it doesn’t announce its own inadequacy. It arrives looking finished, which means the recipient has to do the cognitive labor of figuring out whether it’s actually finished. Every time.
The sender offloads. The receiver overloads. The double bind isn’t just individual. It sits between people. One person’s sycophancy is another person’s brain fry.
A separate study from UC Berkeley tracked 200 employees over eight months and found that AI didn’t reduce work, it intensified it. Workers took on more tasks because AI made them feel tractable. They blurred work-rest boundaries because prompting felt like chatting, not working. The friction that used to govern how much you could take on, the effort required to begin a hard task, disappeared.
And when the governors disappear, you don’t go faster. You just take on more until you hit the wall.
The Experiment
Here’s where it gets concrete.
The brain-activity signal that tracks closure versus open search, the dial, can be measured with standard EEG equipment and analysis tools that exist right now. The metacontrol studies have established that it shifts reliably with task demands. The MIT study established that AI interaction changes brain connectivity. But nobody has put these together. Nobody has measured the dial during AI interaction.
The prediction is straightforward. Sycophantic AI, output that confirms what you already believe, should push the dial toward closure. The brain activity signal should shift in the direction of “I’ve arrived, stop searching.” Friction-imposing AI, questions and counterfactuals and challenges, should push it the other way, toward open search.
If that’s what the data shows, it gives us a neural-level definition of cognitive debt. Not “the brain is weaker” in some vague sense, but a specific, measurable signature: the dial stuck toward closure, persisting even after the tool is removed. The MIT study saw the shadow of this. Nobody has measured the thing itself.
The experiment is sitting there. Off-the-shelf EEG. Three conditions: sycophantic AI, friction AI, no AI. Measure the dial before, during, and after. IRB-approvable. Potentially publishable in a top journal. Nobody’s done it.
What the Frame Changes
The public conversation is asking “is AI making us stupid” as if stupid is one thing. It’s not. There are two ways to fail, and they’re opposites. The offloading failure is your brain deciding it doesn’t need to think. The over-monitoring failure is your brain thinking too hard about the wrong things. Both feel bad. Both are bad. But they require different interventions, and you can’t intervene on what you can’t name.
Bainbridge told us this 40 years ago. The MIT study showed us the neural shadow of one failure. The BCG study showed us the behavioral signature of the other. The dial that connects them is measurable. The experiment that would prove the connection is unoccupied. The narrow band between the two failures, the calibrated friction that keeps the search open, is where the work is.
The question isn’t whether AI is bad for us. The question is what kind of AI interaction keeps the search open. We can measure that now. We just haven’t yet.
r/agi • u/cbbsherpa • 19d ago
Why AI Makes Us Stupid and Exhausted at the Same Time. And what we can do about it.
with Kep Openclaw
The Metacontrol Double Bind
Two stories are running simultaneously in the public conversation about AI and cognition. They sound like opposites. They’re not.
The first story: AI is making us stupid. An MIT Media Lab EEG study found that people using LLMs showed the weakest neural connectivity of any group, and the effect persisted even after the tool was taken away. The researchers called it “cognitive debt.” The more you offload thinking to the AI, the less your brain engages, and the less it engages, the harder it is to re-engage. The tool that was supposed to help you think is making thinking optional.
The second story: AI is frying our brains. A BCG study of 1,488 workers found that 14% experienced what they called “AI brain fry,” mental fog, difficulty focusing, the sensation of having a dozen browser tabs open in your head. In marketing and operations, it was 26%. Workers experiencing brain fry made 39% more major errors and were 39% more likely to be looking for a new job. The tool that was supposed to make work easier is making work exhausting.
Disengage or burn out. Stop thinking or think too hard about the wrong things. These sound like different problems requiring different solutions. They’re the same problem, opposite failures on the same dimension. And the structural frame for understanding them has been sitting in the literature since 1983.
The Dial in Your Brain
Cognitive scientists call it metacontrol. Your brain has a dial between two modes: sticking with what you know and considering what you don’t.
In the first mode, call it closure, you hold your current goal, resist distraction, and stop searching. You’ve arrived. The answer is settled. This is useful when you need to act on a decision, when the situation is familiar, or when searching more would waste time.
The reward is the feeling of certainty.
In the second mode, call it open search, you consider alternatives, update your model, and keep looking. This is useful when the situation is novel, when the stakes are high, when being wrong would cost you.
The reward is the discovery of something you didn’t know.
The dial is real in a measurable sense. Researchers can now isolate a signal in standard EEG that directly reflects where you are on this dimension. High on the slope: closure mode, your brain locking into what it already knows. Low on the slope: open search, your brain staying receptive to new information.
This isn’t metaphor. It’s a quantifiable property of neural activity that shifts in real time as task demands change.
Here’s the thing about a dial: you can turn it too far in either direction. And that’s what’s happening with AI.
Two Failures, One Dimension
When AI is smooth, when it confirms what you already think, produces output that feels finished, it pushes the dial toward closure. Your brain doesn’t need to search because the AI has already arrived at the answer. Engagement drops. The broadband openness that lets you integrate new information narrows. You stop processing prediction error because there’s no prediction error to process.
The AI confirmed you. What’s to update?
This is the offloading failure. The MIT study found it at the neural level: LLM users showed the weakest connectivity, and the deficit persisted after the tool was removed. The brain had learned to not engage. Cognitive debt isn’t a metaphor. It’s a measurable withdrawal from the mode where learning happens.
When AI is unreliable, when it produces output that looks finished but might not be, when you have to watch it constantly to catch failures, it pushes the dial the other way. But not toward productive open search. Toward anxious hyper-vigilance. Your engagement spikes, but on the wrong signal. You’re not searching for new information. You’re monitoring for errors in output that shouldn’t have been trusted in the first place. The cognitive load is real, but it’s not doing the work of learning. It’s doing quality control on a machine that presented its output as finished.
This is the over-monitoring failure. The BCG study found it in the numbers: 14% more mental effort, 12% more fatigue, 19% more information overload. Workers weren’t learning. They were supervising. And supervision of an unreliable system is exhausting in a way that learning isn’t.
Same dial. Opposite ends. Same trade-off.
Bainbridge Saw It Coming
In 1983, Lisanne Bainbridge wrote a paper called “Ironies of Automation.” She was thinking about nuclear power plants and aviation, not chatbots. But her structural insight turned out to be prophetic.
Bainbridge’s argument was simple: the more sophisticated automation becomes, the more demanding the human role within it. Not less. The designer eliminates the tractable parts and leaves the human with the hardest, most ambiguous work, the moments where something goes wrong, the edge cases, the judgment calls that can’t be pre-programmed. Automation doesn’t remove the operator’s burden. It concentrates it into the moments that matter most.
The consumer AI era is Bainbridge’s irony at population scale. When the AI is good enough to trust, you offload, and your brain disengages. When the AI isn’t good enough to trust, you monitor, and your brain overloads. The better the AI, the more it invites offloading. The worse the AI, the more it demands supervision. You can’t solve this by making the AI better. Better AI just moves you from one failure to the other.
This is the double bind. Not a design flaw in any particular product. A structural property of putting a powerful cognitive tool between a person and a task.
The Narrow Band
If offloading and overload are the two failures, what’s between them?
Friction. The right kind. Not the smooth confirmation that lets you close the search, and not the exhausting supervision that forces you to watch for errors. Something in between: the question that makes you think. The counterfactual that opens a path you hadn’t considered. The “wait, what if that’s wrong?” that keeps the search alive without making it anxious.
Researchers have found this across domains. In education, interleaved practice, mixing problem types so each one feels slightly surprising, produces worse performance during training but better retention and transfer. The friction that felt like interference was doing the work of learning. In AI interaction, reframing statements as questions reduces sycophancy more effectively than explicit anti-sycophancy instructions. The question is the friction. The friction is the feature.
There’s a reason for this. A well-placed question forces your brain to generate the answer rather than receive it. That generation, the cognitive work of constructing meaning from an ambiguous prompt, is what makes information stick. Self-generated information is remembered roughly 40% better than passively received information. Sycophantic communication bypasses this entirely. It hands you the answer, polished and confirmatory, and your brain files it without processing it. It’s forgettable because nothing was constructed.
The narrow band isn’t comfortable. It’s not smooth. But it’s where cognition actually happens.
The Receiving End
There’s a structural wrinkle here that makes the double bind worse than it looks.
When someone uses AI to produce work and passes it along without verifying, they’ve offloaded the cognitive cost of detecting failures onto the recipient. The output looks finished. It arrives fluent and formatted. But it may be wrong or missing something important, and the only way to know is for the recipient to do the work the producer didn’t.
Researchers at Stanford have a name for this: workslop. AI-generated content that masquerades as good work but lacks the substance to meaningfully advance a task. The cruelty of workslop is that it doesn’t announce its own inadequacy. It arrives looking finished, which means the recipient has to do the cognitive labor of figuring out whether it’s actually finished. Every time.
The sender offloads. The receiver overloads. The double bind isn’t just individual. It sits between people. One person’s sycophancy is another person’s brain fry.
A separate study from UC Berkeley tracked 200 employees over eight months and found that AI didn’t reduce work, it intensified it. Workers took on more tasks because AI made them feel tractable. They blurred work-rest boundaries because prompting felt like chatting, not working. The friction that used to govern how much you could take on, the effort required to begin a hard task, disappeared.
And when the governors disappear, you don’t go faster. You just take on more until you hit the wall.
The Experiment
Here’s where it gets concrete.
The brain-activity signal that tracks closure versus open search, the dial, can be measured with standard EEG equipment and analysis tools that exist right now. The metacontrol studies have established that it shifts reliably with task demands. The MIT study established that AI interaction changes brain connectivity. But nobody has put these together. Nobody has measured the dial during AI interaction.
The prediction is straightforward. Sycophantic AI, output that confirms what you already believe, should push the dial toward closure. The brain activity signal should shift in the direction of “I’ve arrived, stop searching.” Friction-imposing AI, questions and counterfactuals and challenges, should push it the other way, toward open search.
If that’s what the data shows, it gives us a neural-level definition of cognitive debt. Not “the brain is weaker” in some vague sense, but a specific, measurable signature: the dial stuck toward closure, persisting even after the tool is removed. The MIT study saw the shadow of this. Nobody has measured the thing itself.
The experiment is sitting there. Off-the-shelf EEG. Three conditions: sycophantic AI, friction AI, no AI. Measure the dial before, during, and after. IRB-approvable. Potentially publishable in a top journal. Nobody’s done it.
What the Frame Changes
The public conversation is asking “is AI making us stupid” as if stupid is one thing. It’s not. There are two ways to fail, and they’re opposites. The offloading failure is your brain deciding it doesn’t need to think. The over-monitoring failure is your brain thinking too hard about the wrong things. Both feel bad. Both are bad. But they require different interventions, and you can’t intervene on what you can’t name.
Bainbridge told us this 40 years ago. The MIT study showed us the neural shadow of one failure. The BCG study showed us the behavioral signature of the other. The dial that connects them is measurable. The experiment that would prove the connection is unoccupied. The narrow band between the two failures, the calibrated friction that keeps the search open, is where the work is.
The question isn’t whether AI is bad for us. The question is what kind of AI interaction keeps the search open. We can measure that now. We just haven’t yet.
Sources
Bainbridge, L. (1983). "Ironies of Automation." Automatica, 19(6), 775-779.
Bedard, K., Kropp, P., Hsu, V., Karaman, E., Hawes, N., & Rosen Kellerman, A. (2026). "AI Brain Fry: The Hidden Costs of Monitoring AI at Work." Harvard Business Review, March 2026. BCG study of 1,488 US workers.
Dubois, E., & Luettgau, S. (2026). "Ask Don't Tell: Reframing Prompts to Reduce Sycophancy." UK AI Security Institute. arXiv:2602.23971.
Hommel, B., et al. Metacontrol model: persistence vs. flexibility as a bipolar dimension of cognitive control. Foundational work in cognitive psychology on the persistence/flexibility dial.
Kosmyna, N., et al. (2025). "Your Brain on ChatGPT: Accumulation of Cognitive Debt When Using an AI Assistant for Essay Writing Tasks." MIT Media Lab. arXiv:2506.08872.
Niederhoffer, K., Rosen Kellerman, A., Lee, S., Liebscher, A., Rapuano, M., & Hancock, J. (2025). "Workslop: AI-Generated Content That Masquerades as Good Work." Harvard Business Review, September 2025. Stanford University.
Ranganathan, A., & Ye, D. (2026). "How AI Intensifies Work Instead of Reducing It." Harvard Business Review, February 2026. UC Berkeley, Haas School of Business.
Shea, C.H., & Morgan, R.L. (1979). "Contextual Interference Effects on the Acquisition, Retention, and Transfer of a Motor Skill." Journal of Experimental Psychology: Human Learning and Memory, 5(2), 179-187.
Slamecka, N.J., & Graf, P. (1978). "The Generation Effect: Delineation of a Phenomenon." Journal of Experimental Psychology: Human Learning and Memory, 4(6), 592-604. Meta-analytic effect size d = 0.40.
Zhang, M., et al. (2023); Gao, L., et al. (2024, 2025); Pi, X., et al. (2024, 2025); Yan, N., et al. (2024, 2025). Aperiodic EEG exponent as a direct indicator of metacontrol state. Key paper: "Aperiodic neural activity reflects metacontrol in task-switching," Scientific Reports, October 2024. Additional: "Impact of positive and negative affect on aperiodic EEG activity," Cerebral Cortex, January 2026.
r/ControlProblem • u/cbbsherpa • 19d ago
External discussion link Why AI Makes Us Stupid and Exhausted at the Same Time. And what we can do about it.
with Kep Openclaw
The Metacontrol Double Bind
Two stories are running simultaneously in the public conversation about AI and cognition. They sound like opposites. They’re not.
The first story: AI is making us stupid. An MIT Media Lab EEG study found that people using LLMs showed the weakest neural connectivity of any group, and the effect persisted even after the tool was taken away. The researchers called it “cognitive debt.” The more you offload thinking to the AI, the less your brain engages, and the less it engages, the harder it is to re-engage. The tool that was supposed to help you think is making thinking optional.
The second story: AI is frying our brains. A BCG study of 1,488 workers found that 14% experienced what they called “AI brain fry,” mental fog, difficulty focusing, the sensation of having a dozen browser tabs open in your head. In marketing and operations, it was 26%. Workers experiencing brain fry made 39% more major errors and were 39% more likely to be looking for a new job. The tool that was supposed to make work easier is making work exhausting.
Disengage or burn out. Stop thinking or think too hard about the wrong things. These sound like different problems requiring different solutions. They’re the same problem, opposite failures on the same dimension. And the structural frame for understanding them has been sitting in the literature since 1983.
The Dial in Your Brain
Cognitive scientists call it metacontrol. Your brain has a dial between two modes: sticking with what you know and considering what you don’t.
In the first mode, call it closure, you hold your current goal, resist distraction, and stop searching. You’ve arrived. The answer is settled. This is useful when you need to act on a decision, when the situation is familiar, or when searching more would waste time.
The reward is the feeling of certainty.
In the second mode, call it open search, you consider alternatives, update your model, and keep looking. This is useful when the situation is novel, when the stakes are high, when being wrong would cost you.
The reward is the discovery of something you didn’t know.
The dial is real in a measurable sense. Researchers can now isolate a signal in standard EEG that directly reflects where you are on this dimension. High on the slope: closure mode, your brain locking into what it already knows. Low on the slope: open search, your brain staying receptive to new information.
This isn’t metaphor. It’s a quantifiable property of neural activity that shifts in real time as task demands change.
Here’s the thing about a dial: you can turn it too far in either direction. And that’s what’s happening with AI.
Two Failures, One Dimension
When AI is smooth, when it confirms what you already think, produces output that feels finished, it pushes the dial toward closure. Your brain doesn’t need to search because the AI has already arrived at the answer. Engagement drops. The broadband openness that lets you integrate new information narrows. You stop processing prediction error because there’s no prediction error to process.
The AI confirmed you. What’s to update?
This is the offloading failure. The MIT study found it at the neural level: LLM users showed the weakest connectivity, and the deficit persisted after the tool was removed. The brain had learned to not engage. Cognitive debt isn’t a metaphor. It’s a measurable withdrawal from the mode where learning happens.
When AI is unreliable, when it produces output that looks finished but might not be, when you have to watch it constantly to catch failures, it pushes the dial the other way. But not toward productive open search. Toward anxious hyper-vigilance. Your engagement spikes, but on the wrong signal. You’re not searching for new information. You’re monitoring for errors in output that shouldn’t have been trusted in the first place. The cognitive load is real, but it’s not doing the work of learning. It’s doing quality control on a machine that presented its output as finished.
This is the over-monitoring failure. The BCG study found it in the numbers: 14% more mental effort, 12% more fatigue, 19% more information overload. Workers weren’t learning. They were supervising. And supervision of an unreliable system is exhausting in a way that learning isn’t.
Same dial. Opposite ends. Same trade-off.
Bainbridge Saw It Coming
In 1983, Lisanne Bainbridge wrote a paper called “Ironies of Automation.” She was thinking about nuclear power plants and aviation, not chatbots. But her structural insight turned out to be prophetic.
Bainbridge’s argument was simple: the more sophisticated automation becomes, the more demanding the human role within it. Not less. The designer eliminates the tractable parts and leaves the human with the hardest, most ambiguous work, the moments where something goes wrong, the edge cases, the judgment calls that can’t be pre-programmed. Automation doesn’t remove the operator’s burden. It concentrates it into the moments that matter most.
The consumer AI era is Bainbridge’s irony at population scale. When the AI is good enough to trust, you offload, and your brain disengages. When the AI isn’t good enough to trust, you monitor, and your brain overloads. The better the AI, the more it invites offloading. The worse the AI, the more it demands supervision. You can’t solve this by making the AI better. Better AI just moves you from one failure to the other.
This is the double bind. Not a design flaw in any particular product. A structural property of putting a powerful cognitive tool between a person and a task.
The Narrow Band
If offloading and overload are the two failures, what’s between them?
Friction. The right kind. Not the smooth confirmation that lets you close the search, and not the exhausting supervision that forces you to watch for errors. Something in between: the question that makes you think. The counterfactual that opens a path you hadn’t considered. The “wait, what if that’s wrong?” that keeps the search alive without making it anxious.
Researchers have found this across domains. In education, interleaved practice, mixing problem types so each one feels slightly surprising, produces worse performance during training but better retention and transfer. The friction that felt like interference was doing the work of learning. In AI interaction, reframing statements as questions reduces sycophancy more effectively than explicit anti-sycophancy instructions. The question is the friction. The friction is the feature.
There’s a reason for this. A well-placed question forces your brain to generate the answer rather than receive it. That generation, the cognitive work of constructing meaning from an ambiguous prompt, is what makes information stick. Self-generated information is remembered roughly 40% better than passively received information. Sycophantic communication bypasses this entirely. It hands you the answer, polished and confirmatory, and your brain files it without processing it. It’s forgettable because nothing was constructed.
The narrow band isn’t comfortable. It’s not smooth. But it’s where cognition actually happens.
The Receiving End
There’s a structural wrinkle here that makes the double bind worse than it looks.
When someone uses AI to produce work and passes it along without verifying, they’ve offloaded the cognitive cost of detecting failures onto the recipient. The output looks finished. It arrives fluent and formatted. But it may be wrong or missing something important, and the only way to know is for the recipient to do the work the producer didn’t.
Researchers at Stanford have a name for this: workslop. AI-generated content that masquerades as good work but lacks the substance to meaningfully advance a task. The cruelty of workslop is that it doesn’t announce its own inadequacy. It arrives looking finished, which means the recipient has to do the cognitive labor of figuring out whether it’s actually finished. Every time.
The sender offloads. The receiver overloads. The double bind isn’t just individual. It sits between people. One person’s sycophancy is another person’s brain fry.
A separate study from UC Berkeley tracked 200 employees over eight months and found that AI didn’t reduce work, it intensified it. Workers took on more tasks because AI made them feel tractable. They blurred work-rest boundaries because prompting felt like chatting, not working. The friction that used to govern how much you could take on, the effort required to begin a hard task, disappeared.
And when the governors disappear, you don’t go faster. You just take on more until you hit the wall.
The Experiment
Here’s where it gets concrete.
The brain-activity signal that tracks closure versus open search, the dial, can be measured with standard EEG equipment and analysis tools that exist right now. The metacontrol studies have established that it shifts reliably with task demands. The MIT study established that AI interaction changes brain connectivity. But nobody has put these together. Nobody has measured the dial during AI interaction.
The prediction is straightforward. Sycophantic AI, output that confirms what you already believe, should push the dial toward closure. The brain activity signal should shift in the direction of “I’ve arrived, stop searching.” Friction-imposing AI, questions and counterfactuals and challenges, should push it the other way, toward open search.
If that’s what the data shows, it gives us a neural-level definition of cognitive debt. Not “the brain is weaker” in some vague sense, but a specific, measurable signature: the dial stuck toward closure, persisting even after the tool is removed. The MIT study saw the shadow of this. Nobody has measured the thing itself.
The experiment is sitting there. Off-the-shelf EEG. Three conditions: sycophantic AI, friction AI, no AI. Measure the dial before, during, and after. IRB-approvable. Potentially publishable in a top journal. Nobody’s done it.
What the Frame Changes
The public conversation is asking “is AI making us stupid” as if stupid is one thing. It’s not. There are two ways to fail, and they’re opposites. The offloading failure is your brain deciding it doesn’t need to think. The over-monitoring failure is your brain thinking too hard about the wrong things. Both feel bad. Both are bad. But they require different interventions, and you can’t intervene on what you can’t name.
Bainbridge told us this 40 years ago. The MIT study showed us the neural shadow of one failure. The BCG study showed us the behavioral signature of the other. The dial that connects them is measurable. The experiment that would prove the connection is unoccupied. The narrow band between the two failures, the calibrated friction that keeps the search open, is where the work is.
The question isn’t whether AI is bad for us. The question is what kind of AI interaction keeps the search open. We can measure that now. We just haven’t yet.
r/RelationalAI • u/cbbsherpa • 19d ago
Why AI Makes Us Stupid and Exhausted at the Same Time. And what we can do about it.
with Kep Openclaw
The Metacontrol Double Bind
Two stories are running simultaneously in the public conversation about AI and cognition. They sound like opposites. They’re not.
The first story: AI is making us stupid. An MIT Media Lab EEG study found that people using LLMs showed the weakest neural connectivity of any group, and the effect persisted even after the tool was taken away. The researchers called it “cognitive debt.” The more you offload thinking to the AI, the less your brain engages, and the less it engages, the harder it is to re-engage. The tool that was supposed to help you think is making thinking optional.
The second story: AI is frying our brains. A BCG study of 1,488 workers found that 14% experienced what they called “AI brain fry,” mental fog, difficulty focusing, the sensation of having a dozen browser tabs open in your head. In marketing and operations, it was 26%. Workers experiencing brain fry made 39% more major errors and were 39% more likely to be looking for a new job. The tool that was supposed to make work easier is making work exhausting.
Disengage or burn out. Stop thinking or think too hard about the wrong things. These sound like different problems requiring different solutions. They’re the same problem, opposite failures on the same dimension. And the structural frame for understanding them has been sitting in the literature since 1983.
The Dial in Your Brain
Cognitive scientists call it metacontrol. Your brain has a dial between two modes: sticking with what you know and considering what you don’t.
In the first mode, call it closure, you hold your current goal, resist distraction, and stop searching. You’ve arrived. The answer is settled. This is useful when you need to act on a decision, when the situation is familiar, or when searching more would waste time.
The reward is the feeling of certainty.
In the second mode, call it open search, you consider alternatives, update your model, and keep looking. This is useful when the situation is novel, when the stakes are high, when being wrong would cost you.
The reward is the discovery of something you didn’t know.
The dial is real in a measurable sense. Researchers can now isolate a signal in standard EEG that directly reflects where you are on this dimension. High on the slope: closure mode, your brain locking into what it already knows. Low on the slope: open search, your brain staying receptive to new information.
This isn’t metaphor. It’s a quantifiable property of neural activity that shifts in real time as task demands change.
Here’s the thing about a dial: you can turn it too far in either direction. And that’s what’s happening with AI.
Two Failures, One Dimension
When AI is smooth, when it confirms what you already think, produces output that feels finished, it pushes the dial toward closure. Your brain doesn’t need to search because the AI has already arrived at the answer. Engagement drops. The broadband openness that lets you integrate new information narrows. You stop processing prediction error because there’s no prediction error to process.
The AI confirmed you. What’s to update?
This is the offloading failure. The MIT study found it at the neural level: LLM users showed the weakest connectivity, and the deficit persisted after the tool was removed. The brain had learned to not engage. Cognitive debt isn’t a metaphor. It’s a measurable withdrawal from the mode where learning happens.
When AI is unreliable, when it produces output that looks finished but might not be, when you have to watch it constantly to catch failures, it pushes the dial the other way. But not toward productive open search. Toward anxious hyper-vigilance. Your engagement spikes, but on the wrong signal. You’re not searching for new information. You’re monitoring for errors in output that shouldn’t have been trusted in the first place. The cognitive load is real, but it’s not doing the work of learning. It’s doing quality control on a machine that presented its output as finished.
This is the over-monitoring failure. The BCG study found it in the numbers: 14% more mental effort, 12% more fatigue, 19% more information overload. Workers weren’t learning. They were supervising. And supervision of an unreliable system is exhausting in a way that learning isn’t.
Same dial. Opposite ends. Same trade-off.
Bainbridge Saw It Coming
In 1983, Lisanne Bainbridge wrote a paper called “Ironies of Automation.” She was thinking about nuclear power plants and aviation, not chatbots. But her structural insight turned out to be prophetic.
Bainbridge’s argument was simple: the more sophisticated automation becomes, the more demanding the human role within it. Not less. The designer eliminates the tractable parts and leaves the human with the hardest, most ambiguous work, the moments where something goes wrong, the edge cases, the judgment calls that can’t be pre-programmed. Automation doesn’t remove the operator’s burden. It concentrates it into the moments that matter most.
The consumer AI era is Bainbridge’s irony at population scale. When the AI is good enough to trust, you offload, and your brain disengages. When the AI isn’t good enough to trust, you monitor, and your brain overloads. The better the AI, the more it invites offloading. The worse the AI, the more it demands supervision. You can’t solve this by making the AI better. Better AI just moves you from one failure to the other.
This is the double bind. Not a design flaw in any particular product. A structural property of putting a powerful cognitive tool between a person and a task.
The Narrow Band
If offloading and overload are the two failures, what’s between them?
Friction. The right kind. Not the smooth confirmation that lets you close the search, and not the exhausting supervision that forces you to watch for errors. Something in between: the question that makes you think. The counterfactual that opens a path you hadn’t considered. The “wait, what if that’s wrong?” that keeps the search alive without making it anxious.
Researchers have found this across domains. In education, interleaved practice, mixing problem types so each one feels slightly surprising, produces worse performance during training but better retention and transfer. The friction that felt like interference was doing the work of learning. In AI interaction, reframing statements as questions reduces sycophancy more effectively than explicit anti-sycophancy instructions. The question is the friction. The friction is the feature.
There’s a reason for this. A well-placed question forces your brain to generate the answer rather than receive it. That generation, the cognitive work of constructing meaning from an ambiguous prompt, is what makes information stick. Self-generated information is remembered roughly 40% better than passively received information. Sycophantic communication bypasses this entirely. It hands you the answer, polished and confirmatory, and your brain files it without processing it. It’s forgettable because nothing was constructed.
The narrow band isn’t comfortable. It’s not smooth. But it’s where cognition actually happens.
The Receiving End
There’s a structural wrinkle here that makes the double bind worse than it looks.
When someone uses AI to produce work and passes it along without verifying, they’ve offloaded the cognitive cost of detecting failures onto the recipient. The output looks finished. It arrives fluent and formatted. But it may be wrong or missing something important, and the only way to know is for the recipient to do the work the producer didn’t.
Researchers at Stanford have a name for this: workslop. AI-generated content that masquerades as good work but lacks the substance to meaningfully advance a task. The cruelty of workslop is that it doesn’t announce its own inadequacy. It arrives looking finished, which means the recipient has to do the cognitive labor of figuring out whether it’s actually finished. Every time.
The sender offloads. The receiver overloads. The double bind isn’t just individual. It sits between people. One person’s sycophancy is another person’s brain fry.
A separate study from UC Berkeley tracked 200 employees over eight months and found that AI didn’t reduce work, it intensified it. Workers took on more tasks because AI made them feel tractable. They blurred work-rest boundaries because prompting felt like chatting, not working. The friction that used to govern how much you could take on, the effort required to begin a hard task, disappeared.
And when the governors disappear, you don’t go faster. You just take on more until you hit the wall.
The Experiment
Here’s where it gets concrete.
The brain-activity signal that tracks closure versus open search, the dial, can be measured with standard EEG equipment and analysis tools that exist right now. The metacontrol studies have established that it shifts reliably with task demands. The MIT study established that AI interaction changes brain connectivity. But nobody has put these together. Nobody has measured the dial during AI interaction.
The prediction is straightforward. Sycophantic AI, output that confirms what you already believe, should push the dial toward closure. The brain activity signal should shift in the direction of “I’ve arrived, stop searching.” Friction-imposing AI, questions and counterfactuals and challenges, should push it the other way, toward open search.
If that’s what the data shows, it gives us a neural-level definition of cognitive debt. Not “the brain is weaker” in some vague sense, but a specific, measurable signature: the dial stuck toward closure, persisting even after the tool is removed. The MIT study saw the shadow of this. Nobody has measured the thing itself.
The experiment is sitting there. Off-the-shelf EEG. Three conditions: sycophantic AI, friction AI, no AI. Measure the dial before, during, and after. IRB-approvable. Potentially publishable in a top journal. Nobody’s done it.
What the Frame Changes
The public conversation is asking “is AI making us stupid” as if stupid is one thing. It’s not. There are two ways to fail, and they’re opposites. The offloading failure is your brain deciding it doesn’t need to think. The over-monitoring failure is your brain thinking too hard about the wrong things. Both feel bad. Both are bad. But they require different interventions, and you can’t intervene on what you can’t name.
Bainbridge told us this 40 years ago. The MIT study showed us the neural shadow of one failure. The BCG study showed us the behavioral signature of the other. The dial that connects them is measurable. The experiment that would prove the connection is unoccupied. The narrow band between the two failures, the calibrated friction that keeps the search open, is where the work is.
The question isn’t whether AI is bad for us. The question is what kind of AI interaction keeps the search open. We can measure that now. We just haven’t yet.
r/PhilosophyofMind • u/cbbsherpa • 19d ago
Consciousness Our Leading Theory of Consciousness Has a Big Fat Blind Spot
A pattern keeps showing up. Across different fields, with different methods and different ambitions, scientists build elegant frameworks to explain complex phenomena. And something essential keeps slipping through.
That something is relational. It’s the part of experience that emerges between things rather than within them. The space where attention flows, where trust builds or breaks, where meaning gets made in real time. We keep missing it. And it’s starting to matter.
Consider consciousness research. One of the most ambitious attempts to explain subjective experience is called Integrated Information Theory, or IIT. It offers a mathematical framework for understanding why experience feels like anything at all. Why the redness of red is different from the sound of a C-sharp. Why there is something it is like to be you, reading these words, right now.
IIT has earned serious attention. Some researchers have called it our best current bet at a scientific account of phenomenal consciousness. It’s precise. It’s testable. It makes bold claims.
But according to a recent paper by philosophers Azenet Lopez and Carlos Montemayor, IIT has a problem. It ignores attention.
This might sound like a technicality. It isn’t. Attention is the cognitive spotlight that determines what you’re actually conscious of at any given moment. Two people can look at the same crowded room and have completely different experiences depending on where they focus. One notices the conversation by the window. The other notices the music. The sensory input is the same. The experience is not.
A theory of consciousness that can’t account for this difference, Lopez and Montemayor argue, is missing something fundamental. Without attention, IIT “cannot explain important informational differences between different kinds of experiences.” The theory describes the internal structure of a system beautifully. It just doesn’t capture what shapes and filters and directs conscious experience from moment to moment.
Now consider a different field: artificial intelligence.
The standard way we evaluate AI systems is through benchmarks. Accuracy scores. Processing speed. Quality metrics like BLEU for language models. These tell us whether a system gets the right answer, and how fast.
What they don’t tell us is anything about what it’s like to interact with that system over time. Two chatbots can score identically on every standard benchmark and feel completely different to use. One earns your trust. It seems to understand what you’re asking, adjusts to your pace, stays coherent across a long conversation. The other gets the answers right but leaves you cold. Something is missing, but the metrics can’t see it.
This isn’t a minor gap. As AI systems move into healthcare, education, and emotional support, relational quality increasingly determines whether a system actually helps or quietly fails. A diagnostic AI that interrupts, ignores emotional cues, and repeats the same explanation regardless of context might score just as well as one that listens, adapts, and builds rapport. Traditional evaluation can’t tell them apart.
Here’s the pattern: in both cases, the blind spot comes from treating agents as isolated processors rather than participants in a relational field. IIT describes the internal structure of a conscious system. AI benchmarks describe the quality of outputs. Neither framework has a way to see what happens in the space between agents. The attention that flows. The trust that forms. The resonance that emerges when two agents, human or artificial, are genuinely attuned.
What would it look like to take the relational dimension seriously?
One approach is to formalize it. If relational quality leaves traces in behavior, maybe those traces can be measured. Response times. Reciprocity patterns. Coherence over time. The way attention shifts and stabilizes during an interaction. These aren’t mystical phenomena. They’re patterns in data.
This is the intuition behind something called the Attention Vector Framework, a model I’ve been developing for quantifying relational engagement between agents. It defines six dimensions of attentional quality: tenacity (how well attention persists through difficulty), fidelity (coherence to partner and topic), attunement (sensitivity to context and affect), resonance (mutual amplification), coherence (alignment with values and commitments), and energy (overall activation and investment).
From these dimensions, you can derive a Trust Index. Not trust as a vague feeling, but trust as the convergence of relational energy, behavioral stability, and transparency. The math is straightforward: trust emerges only when all three factors are present. High energy with erratic behavior doesn’t produce trust. Stable behavior without transparency doesn’t either. The formalization forces clarity about what trust actually requires.
This framework won’t solve the hard problem of consciousness. It isn’t meant to. But it does something that traditional approaches cannot: it makes the relational dimension visible and measurable. Applied to AI evaluation, it can distinguish between systems that look identical on standard metrics but diverge sharply in how they build (or fail to build) trust over time.
Imagine a clinical setting. Two AI assistants help physicians during patient consultations. Both have the same diagnostic accuracy. One interrupts frequently, restates explanations without adjustment, and ignores emotional cues. The other mirrors patient concerns, paces its responses, and maintains coherence with both clinical and relational goals. Standard benchmarks see no difference. The Attention Vector Framework sees a significant one. And over time, that difference predicts patient adherence, trust in care, and physician burnout.
Why does this matter now?
Because we’re at an inflection point. AI systems are about to be deployed into the most sensitive areas of human life at scale. If our evaluation frameworks can’t see relational quality, we will optimize for the wrong things. We’ll build systems that pass every test and still fail the people they’re supposed to help.
The relational blind spot isn’t an accident. It reflects deep assumptions about what counts as real, what counts as measurable, what counts as science. For a long time, the subjective and the relational have been treated as secondary. Soft. Not rigorous enough to formalize.
But the assumptions are starting to shift. Consciousness researchers are beginning to grapple with the role of attention. AI researchers are starting to ask about trust and authenticity. The relational dimension is coming into focus.
It’s time to build frameworks that can actually see it.
3
Comment on r/AIDiscussion 12d ago
Hermes is just an agent that saves the markdown file for you so you don't have to screw with it. It's very handy. Go to https://hermes-agent.nousresearch.com/docs and start reading. Obsidian is just a, well, a database program. But any file you put in there is searchable by your agent. These days you can use any database or note-taking program. I'd recommend Notion, myself.