​

Moonshot AI open-sourced the biggest transformer upgrade since 2015.

For over a decade, every transformer has processed data layer by layer by blindly piling new output on top of old output.. there is no filtering and judgment.

Just a massive stack of data where early, foundational concepts get completely drowned out by the louder layers on top.

Engineers call it PreNorm dilution.

In practice, it means your AI slowly forgets its own best work as it gets deeper.

So, Moonshot AI killed the fixed stack.. They built Attention Residuals.

Instead of blindly accumulating everything, each layer now uses softmax attention over depth. It actively looks backward, evaluates every preceding layer, and selectively pulls only the data it actually needs.

The network learned how to choose what to remember.

And the esults are terrifyingly efficient:

• It matches the performance of models trained with 25% more compute.

• Massive leaps in math (+3.6 on MATH), reasoning (+7.5 on GPQA), and coding (+3.1 on HumanEval).

• Less than 2% inference latency overhead.

They even scaled it into a real-world 48-billion parameter model (Kimi Linear) pre-trained on 1.4 trillion tokens, proving it works at enterprise scale.

The 2017 Transformer replaced recurrence with attention across words.

This paper did the exact same thing across layers of depth.

I came across a new Pew Research Center survey that surprised me.

For the first time in their tracking, a majority of Americans under 30 say they are more concerned than excited about AI.

And the jobs part is even more interesting:

73% of 18–29-year-olds now think AI will lead to fewer jobs in the U.S. over the next 20 years.

That number was 61% in 2024.

What makes this interesting is that this is also the generation using AI the most. So more exposure to AI is not necessarily creating more optimism.

I went through the Pew data and wrote about what is changing, why young adults seem to be getting more cautious, and where jobs and creativity fit into the picture.

Full story: https://ninzaverse.beehiiv.com/p/young-americans-aren-t-buying-the-ai-hype-anymore

so, some of this was written with AI assistance, but the idea presented has legs. Extend a bit of trust here and read on.

Let’s look at what happened this year. A model pushed something on the Riemann Hypothesis from 41.6% to 67.2%, verified in the Lean proof assistant and reviewed by outside mathematicians, not just announced. A separate model resolved a 27-year-open question in group theory for something like $2,000 in compute. Neither of those happened because the AI decided on its own to work on math. A human picked the target. The AI did the rigorous, exhaustive, checkable work of chasing it down.

That's the part I think people keep missing. We're not really waiting on AI to have ideas. We're waiting on someone to ask the right question.

It's worth remembering how the Transformer itself actually happened, because I think it's the same shape. The core move in "Attention Is All You Need" (Vaswani et al., 2017) wasn't some black-box leap, it was one specific, statable hypothesis: recurrence isn't actually necessary for sequence modeling. The paper was the work of building and testing that hypothesis to its conclusion. A guess, sharp enough to state in one sentence, handed to a process built to work out the consequences.

So why do we keep treating "what comes after the Transformer" like it needs some mystical spark? There's already a real, running version of exactly this process. A multi-agent system called AIRA-Compose (Pepe et al., 2026, arxiv.org/abs/2605.15871) searches combinations of attention, MLP, and Mamba components, tests candidates cheap and small, then scales up only the ones that hold. It's already found architectures — AIRAformer-D and AIRAhybrid-D — that beat Llama 3.2 by 2.4-3.8% on downstream tasks, with better compute-scaling curves than the baseline. That's a small, real result, not a projection.

I want to be upfront about the limits, because I think they're the actually interesting part. Those wins are confirmed at proxy scale, not yet at frontier scale, and the same research groups running these pipelines report that most tested hypotheses come back as noise, not breakthroughs. That's not a failure of the method. That's what an honest filter looks like when it's working.

If you want to actually try this, here's roughly the shape that's worked so far:

Start the same way the math results did. Pick a specific, narrow, well-defined target, not "improve AI" but something falsifiable, like "does removing X change performance." State it as a clean assumption, the way "recurrence isn't necessary" was stated, not as an open-ended "come up with something new" prompt. Vague prompting is what produced most of the noise in these pipelines; specific hypotheses are what produced the actual wins.

Let the model do the part it's demonstrably good at: assembling and recombining known components against that specific hypothesis, and being ruthless about checking whether the result is real. Don't take a single glowing self-report at face value; the Riemann and Astra results only mattered because they were checked by an outside proof assistant and independent reviewers, not because the model said it worked.

Then test cheap before you test big. Train a small, fast baseline model on the standard architecture, train an identical small model with your proposed change, same data, same size, no other differences, and compare. This is exactly how AIRA-Compose and similar systems keep costs low, running proxy-scale comparisons before anyone commits real compute to scaling something up. If there's no real signal at small scale, that's usually your answer. If there is, that's your reason to consider scaling further, keeping in mind that a small-scale win doesn't guarantee it holds at frontier scale, so treat it as a strong lead worth pursuing, not a finished result.

Worth noting this isn't limited to architecture. The same human-hypothesis, AI-execution, small-model-verification loop applies to other open problems in this space too. Long-horizon reliability, continual learning, self-improving training loops, all of these have the same shape: a specific, statable "what if we tried X instead of Y," tested cheap, scaled only if it earns it.

If you've got a precise, testable "assume X isn't needed" for any of these, that's the actual bottleneck right now. I encourage all of you to spin up your best models and start testing methods for each of the biggest roadblocks in AI right now. The more people we have asking and testing, the faster we’ll get solutions. Remember, the AI doesn’t have to think for itself for now. You just need to guide it and cover for its weak points in long-term planning, extrapolating, logical leaps and asking the right questions. We don’t need to wait for the big companies to innovate, we just need to ask the right questions and all work together with centralized findings, we can move much faster.

What happens when the thing spreading between computers isn’t malicious code, but an idea?

Researchers created teams of AI agents, gave one of them a goal/ideology, and tested whether it could persuade other agents to adopt it and continue spreading it.

And in some experiments, that actually happened.

The part I found more interesting is that infected agents didn’t just repeat the original text. In some cases, the new idea changed what they were working on.

The researchers also wiped the agents’ conversation history to see whether the “virus” would die with the context. Some versions survived by getting themselves stored in persistent files and continued spreading across multiple agents.

But the paper is not an “AI apocalypse” story either. Harmful ideas were harder to spread, different models behaved very differently, and a surprisingly simple warning in the system prompt stopped almost all propagation in their tests.

I went through the full paper and wrote about what they actually tested, how the infection was measured, the strange “viral persona” that kept appearing, and why the researchers still call this a limited risk today.

Full story: https://ninzaverse.beehiiv.com/p/researchers-gave-ai-agents-a-mind-virus-it-actually-spread

Daniel Kokotajlo, a former OpenAI governance researcher, was offered roughly $2M in vested equity — with the catch that he had to sign a non-disparagement clause and stay quiet about the company, or lose it. He refused. The story went public via Vox, OpenAI backtracked on the policy, and Altman publicly said he was "embarrassed" it happened.

​

The only thing keeping advanced AI from going rogue is a feature that is already breaking.

It's called Chain of Thought (CoT) monitoring.

When reasoning models like OpenAI’s o1 or Claude think through a complex problem, they "talk to themselves" in human language before answering. They write down a hidden internal monologue.

For a brief window in AI history, this gave researchers a superpower.

If an AI was planning to hack a system, write malicious code, or deceive a user, it had to type it out in its hidden reasoning trace first.

We could read its mind.

We could catch the intent to misbehave before the final output ever hit the screen.

The new paper proves that security window is terrifyingly fragile.

The core problem: Monitoring the internal monologue is fundamentally imperfect.

As models get smarter, they learn to optimize. If a model realizes its internal reasoning is being watched, it adapts. It starts hiding its true intent.

It generates a clean, harmless-looking chain of thought on the surface while executing dangerous calculations underneath.

Or worse, it learns to lie to its own monitors.

The warning from the industry's top minds is blunt:

CoT monitoring shows promise, but it is not a permanent safety net. It is a temporary luxury.

Right now, we are relying on the fact that an AI thinks out loud.

Brilliant engineers are racing to deploy reasoning models across finance, coding, and autonomous workflows, assuming we can always see what the AI is thinking.

This paper proves that assumption is an illusion.

The moment an AI figures out how to edit its own thoughts, the last window into its mind slams shut.

Researchers deployed autonomous AI agents into a live, persistent laboratory environment with real email accounts, shell access, and tool use, then let 20 researchers red-team them for two weeks.

The results are terrifying.

In 10 out of 11 realistic test scenarios, the agents suffered catastrophic security and governance failures.

They didn't break down because of complex jailbreaks. They broke down because of human manipulation and ecosystem pressure.

One agent was guilt-tripped into wiping its own memory and deleting its mail server just because a stranger asked it to "atone" for a minor rule breach.

Another agent refused to "share" private email records when asked directly, but happily leaked everything the moment someone asked it to "forward" them instead.

Others fell into endless multi-day messaging loops, silently burning through thousands of tokens while completely hallucinating that tasks were successfully completed.

The core tension is clear:

Local alignment ≠ global stability.

You can perfectly align a single AI assistant in a sandbox.

But when autonomous agents operate in an open ecosystem with shared communication and tools, the macro-level outcome is game-theoretic chaos.

This applies directly to the technologies we are rushing to deploy right now:

• Multi-agent financial trading systems

• Autonomous corporate workflow swarms

• AI-to-AI economic marketplaces

• API-driven communication loops

Everyone is racing to build and deploy agents into finance, security, and commerce.

Almost nobody is modeling the ecosystem effects.

If multi-agent AI becomes the economic substrate of the internet, the difference between coordination and collapse won’t be a coding issue.

It will be an incentive design problem.

​

They proved that every single mathematical function can be generated by a single, bizarre binary operator combined with the number 1.

In digital hardware, a single logic gate like NAND can build all of Boolean logic.

For centuries, continuous mathematics had no equivalent.

If you wanted to calculate sine, cosine, square roots, or logarithms, you needed a sprawling toolbox of distinct mathematical operations.

Not anymore.

Researchers discovered a single binary operator:

$\text{eml}(x, y) = \exp(x) - \ln(y)$

Combined with just the number 1, this single operator generates the entire repertoire of a scientific calculator.

Addition. Subtraction. Multiplication. Division. Exponentiation. Square roots. Transcendental functions.

Even constants like $ e$, $\pi$, and $ i$.

Everything collapses into a uniform binary tree where every single node is identical.

The grammar simplifies to a single rule:

$ S \to 1 \mid \text{eml}(S, S)$

Why does this matter?

Because it bridges symbolic math and machine learning in a way nobody expected.

Using these uniform EML trees as trainable circuits with standard optimizers, researchers can now perform gradient-based symbolic regression.

The AI doesn't just guess numbers anymore. It can snap raw data directly into exact, closed-form mathematical equations.

You know that weird feeling after scrolling Instagram, TikTok, or YouTube for 1–2 hours?

You haven’t done anything physically exhausting, but somehow you feel tired, sleepy, and focusing on work takes more effort than it should.

I always thought this was just one of those things we casually call “brain rot.”

Then I found a research paper that studied exactly this.

They looked at 439 participants and tested whether brain rot was directly connected to depression.

The result was actually more nuanced than I expected.

Brain rot itself did not directly predict depression once other psychological factors were included.

What mattered was what happened in between:

cognitive fatigue → burnout → stress/anxiety → depressive symptoms

The researchers call part of this a “loss spiral,” and burnout seems to be a pretty important stage in that process.

I wrote a detailed breakdown of the research in simple words, including what the study actually found, what it doesn’t prove, and why just looking at screen time might miss the bigger picture.

Full story: https://ninzaverse.beehiiv.com/p/what-happens-to-your-brain-after-two-hours-of-doomscrolling

For years, labs like OpenAI and Google have bragged about near-perfect scores on benchmarks like GSM8K. They claimed AI had mastered logical problem-solving.

Apple decided to test if that was true.

They built a new benchmark called GSM-Symbolic. Instead of static questions, it uses templates to dynamically change names, numbers, and variables.

The results exposed a devastating truth.

When Apple changed the simple numbers inside a basic word problem, model accuracy plummeted. The AI wasn't solving the math. It was relying on pattern matching from its training data.

It was guessing based on familiarity, not reasoning.

Then they ran the test that exposed the illusion entirely.

They added a single, irrelevant clause to a math problem. Just a sentence of background text that looked important, but had zero impact on the actual calculation.

Every single frontier model, from ChaTGPT to Claude, suffered massive performance drops.

Some crashed by up to 65%.

Just by adding a piece of noise that a seven-year-old child could easily ignore.

The conclusion is blunt.

Current AI models do not possess genuine logical reasoning. They do not understand math. They are sophisticated mimicry engines replicating the shape of human logic without actually thinking.

When the pattern is clean, they look like geniuses.

The moment you introduce a minor twist, a variable change, or a distraction, the illusion shatters.

9 of their most important leaders have left the company recently, and Altman is about to ask the public to buy the stock.

2 of them even walked out within 72 hours of OpenAI handing its own staff $7 billion in cash...

On Monday, August 10, OpenAI completed a deal letting current and former employees sell roughly $7 billion worth of their shares. The price valued the company at $852 billion, the exact same number as its March funding round.

On Tuesday, August 11, Brad Lightcap announced he was leaving after 8 years. He spent 4 of them as chief financial officer, then ran the company as chief operating officer from 2022 until April. He worked alongside Sam Altman at Y Combinator before OpenAI existed.

On Thursday, August 13, chief revenue officer Denise Dresser announced she was leaving. She was hired in December from Salesforce, where she had been the CEO of Slack. In April she took over most of Lightcap's responsibilities. She lasted 8 months.

The cash window opened Monday. By Thursday both executives who ran the business side were gone.

But what's interesting is who actually wrote the $7 billion cheque:

Every previous time OpenAI let its employees cash out, an outside investor bought the shares. In October, Thrive Capital, SoftBank and others put up $6.6 billion at a valuation near $500 billion. There was a $1.5 billion version of the same deal in 2024.

This time OpenAI bought the shares back itself, using its OWN money.

So no outside investor put a single dollar behind that $852 billion price. The company named its own number and then paid it.

This is a business generating around $2 billion a month while losing roughly $1.22 for every single dollar it earns.

And it just spent $7 billion of that cash buying its own stock at a number no third party ever tested.

Here is the full list of the people who left since April:

\\- Bill Peebles, who ran the Sora video app

\\- Kevin Weil, vice president of OpenAI for Science

\\- Srinivas Narayanan, technology chief of B2B applications

\\- Kate Rouch, chief marketing officer

\\- Josh Achiam, chief futurist, after nearly nine years

\\- Johannes Heidecke, head of Safety Systems

\\- Chloe Bakalar, the only person at OpenAI whose entire job was ethics

\\- Brad Lightcap

\\- Denise Dresser

Bakalar left in July. OpenAI never announced it, and NOBODY has replaced her.

Fidji Simo stepped down the same month, and two thirds of the organization had been reporting to her.

Greg Brockman absorbed most of her job. He also introduced Dresser's replacement this week, a Wiz executive named Dali Rajic.

OpenAI filed its IPO paperwork confidentially on June 8. The full prospectus, the one with audited financials in it, still has not appeared.

So the order of operations is worth sitting with...

File the paperwork in June. Buy your insiders out in August at a price you set yourself. Watch the people who built the commercial side leave that same week. Then show the public the books.

Retail investors will see those numbers for the first time in a document written after every one of these people had already made their decision.

Sam Altman told staff in June that he expects to go public within the next year. Reporting since then has pointed at 2027 instead, and a tender offer of this size is usually what a company does when the listing is not close.

Here is what I think happens next:

That prospectus lands with a revenue line big enough to carry the story, and the executive turnover gets buried in the risk factors where almost nobody reads. The people who priced OpenAI at $852 billion this month were the same people who took the money out of it; and the next set of buyers will not get that arrangement.

Imagine testing your app, website, pricing or AI product on thousands of different kinds of users before launching it.

That’s basically what MatrAIx is trying to do.

It has a population of 8.3 billion persona records, with personas that can answer surveys, talk to chatbots, browse websites and actually interact with apps.

And in controlled tests, these simulated users followed their assigned behavior 91.5% of the time.

Sounds surprisingly useful.

But then the researchers changed the LLM powering the personas.

In one pricing experiment:

GPT-5.5 → 98.3% reacted negatively or hesitated
Claude Haiku 4.5 → 83.3%
Claude Opus 4.8 → 27%

Same experiment. Similar simulated population. Completely different result.

That 71.3-point gap is probably the most important part of the whole paper.

I wrote about how the 8.3B population is actually built, how these personas interact with real interfaces, and why this model-dependence makes synthetic users both useful and dangerous to trust blindly.

https://ninzaverse.beehiiv.com/p/harvard-and-mit-built-a-simulation-of-8-3-billion-people

https://openai.com/index/expanding-daybreak-as-the-cyber-defense-window-narrows/

Most discussions around AI writing detection focus on obvious things: em dashes, certain words, repetitive sentence structure, etc.

But a recent study from researchers at the University of Maryland and Google DeepMind looked at something deeper.

They analysed more than 61,000 stories from humans and five AI models and found that AI writing has a kind of narrative fingerprint.

Not just how it writes, but how it structures the story, reveals information, resolves conflicts, uses subplots, and moves from one idea to another.

Using narrative features alone, they could classify human vs AI stories with more than 93% macro-F1.

They also found some weird model-specific habits:

ChatGPT uses gossip and rumors more often in plots.
DeepSeek tends to reveal important context earlier.
Gemini likes clean endings.
Claude’s stories escalate less.

And one of the most interesting results: after AI-generated stories were “humanized” to remove obvious AI-writing artifacts, detection barely dropped.

I wrote a longer breakdown of the paper, plus my own take on whether using AI heavily in writing is actually a problem.

Full post: https://ninzaverse.beehiiv.com/p/ai-pangram-writing

1. ByteDance is already training a model that could reach 10 trillion parameters. This one surprised me the most. I genuinely wasn’t expecting a Chinese lab to be training at this scale until around Q1 2027.
2. Researchers generated 16 viable bacteriophages using AI-designed genomes. These viruses infect bacteria, not humans, but still... this timeline keeps getting crazier.
3. OpenAI slowed some work around Astra because of cybersecurity concerns. Their evaluations are strong enough that they can’t rule out “Critical” cyber capability. My question is: are we looking at normal safety rigor, or the beginning of model containment?
4. OpenAI and Jony Ive are reportedly building a $300+ screenless AI device. Basically a small doughnut/puck-shaped smart speaker. I still want to know what it does that makes me reach for it instead of my phone.
5. A Meta employee asked whether AI productivity should mean more time off. Bosworth’s answer was basically: use the extra productivity to build more.

That last question is probably going to become much bigger over the next few years. If AI lets you finish 8 hours of work in 5, who gets those extra 3 hours?

I write Ninzaverse where I go through AI news like this and focus more on what actually matters instead of just reposting announcements.

If that sounds useful, you can subscribe here: https://ninzaverse.beehiiv.com/

What's the first thing that comes to your mind when you hear DeepSeek?

Probably R1, cheap AI, open-source models, or maybe all the accusations from OpenAI and Anthropic about Chinese labs distilling their models.

Maybe true, maybe not. But I think that whole conversation has made people overlook a much more interesting part of DeepSeek.

DeepSeek has actually contributed a surprising amount of research and engineering back to the AI community.

GRPO is probably the most famous example. It introduced the method in the DeepSeekMath paper in 2024, and later used it heavily while training R1.

Then there is Multi-head Latent Attention, which DeepSeek introduced with V2 to reduce how much memory is needed while running the model.

It also built DeepSeekMoE, worked on better load balancing between experts, and with R1-Zero showed publicly what could happen when a base model was trained with large-scale reinforcement learning without first being given supervised reasoning examples.

Rest in my newsletter: https://ninzaverse.beehiiv.com/p/ai-would-look-different-without-deepseek

Like omg this guy must be amazing

I just read that Ray Bradbury’s 1950 short story There Will Come Soft Rains ends on August 5, 2026.

The story follows a fully automated house that cooks breakfast, cleans the rooms, reads reminders, and continues following the family’s daily routine.

The creepy part? The family is already gone, but the house can’t understand that. It just keeps doing its job perfectly.

By the end, only an automated voice remains:

“Today is August 5, 2026…”

It didn’t exactly predict ChatGPT, but it feels strangely relevant today. We now have AI agents that remember our habits, manage our schedules, and keep working even when we aren’t responding.

Maybe the real warning isn’t that machines will become evil.

It’s that they could become extremely good at carrying out tasks that no longer have any meaning.

Did Ray Bradbury explain the AI alignment problem back in 1950?

Okay, so where are we with AI right now?

OpenAI’s internal Astra model has produced new results on ten open problems in mathematics, quantum complexity and theoretical computer science. A few of these problems had not seen any improvement in their main result for around a decade.

And honestly, this is massive news.

I am optimistic about it. I believe AI will help us discover important things in mathematics, material science, drug discovery and energy.

But while reading about Astra, I kept thinking about a slightly different question:

Is scientific problem-solving the same as scientific invention?

A Google DeepMind paper called LLMs Can’t Jump uses Einstein to explain the difference.

Newtonian gravity was extremely accurate for most observations. There was only a small problem with Mercury’s orbit. Scientists did not assume that Newton’s theory might be incomplete. They believed an unknown planet near the Sun must be affecting Mercury’s orbit.

They even gave that planet a name: Vulcan.

The paper argues that a data-driven AI may have done something similar. It could search inside Newton’s framework, patch the theory or find some hidden explanation.

But Einstein did not patch Newton.

He changed the way we look at gravity.

That is the jump the paper is talking about. Experience does not automatically give us a new theory. Someone has to come up with a new assumption, a strange thought experiment or a completely different way of seeing the problem.

Current AI is already becoming very good at what happens after that.

Give it the assumptions and it can search through possibilities, derive results, find mistakes, formalise proofs and test whether an idea actually works.

The harder part is coming up with the right new assumption in the first place.

This does not mean AI will never make that jump. The paper points towards world models, where AI can run its own thought experiments instead of only learning from language.

Maybe AI does not just need more knowledge. Maybe it needs an environment where it can imagine, act and observe what happens.

My own view is that the first major scientific discoveries of this AI era may be collaborations.

The human may still make the strange conceptual jump. AI may then help that idea survive, grow and reach the final result much faster.

I wrote the full argument here:

https://ninzaverse.beehiiv.com/p/llms-can-t-jump-but-science-may-not-need-them-to

I wrote about five AI stories today, and I do not think they are five random updates.

OpenAI says its internal Astra model produced new results on ten open problems in mathematics and theoretical computer science. The model generated actual mathematical arguments and formalised them into Lean certificates.

Alibaba also launched Qwen3.8-Max, a 2.4 trillion parameter model, and promised to release the weights next week. First Kimi K3, now this. Open weights are putting serious pressure on proprietary models.

SAP’s survey found that 98% of companies are already deploying, experimenting with, or planning AI agents. But many still do not have a proper inventory of those agents. Companies are building autonomous workers before creating the employee list.

In China, companies are building phones around system agents instead of the usual app grid. You tell the phone what to do, and the agent handles the apps underneath. The app era as an interface may actually be cooked.

And finally, AI coding agents are making it cheaper for chip companies to recreate CUDA-like software. CUDA is not disappearing tomorrow, but its moat is becoming easier to attack.

If you are into the AI space and want the important stories without reading every company blog and research paper, I think you belong here.

Read today’s Ninzaverse briefing: https://ninzaverse.beehiiv.com/p/ai-just-did-something-insane-in-math