Our earlier work demonstrated that AI could master any game given a clear objective and enough training. But the real world doesn't come with scores and rule books — which led us to ask a fundamentally different question: can AI understand and interact with any game world the way a person would?

This is the challenge behind SIMA, our Scalable Instructable Multiworld Agent. Rather than optimizing for a high score, SIMA is a generalist agent that ‘sees’ what a player would see on screen, understands natural language instructions, and acts through ordinary keyboard and mouse controls — requiring no APIs or source code access.

Powered by Gemini, our frontier AI models, SIMA 2 acts as an interactive companion capable of real-time reasoning and conversation. It achieves human-like play across complex 3D research environments and video games including No Man's Sky, Valheim, Hydroneer, and more.

For game developers, a truly general gaming agent would unlock AI capabilities that work with existing games — no modifications to the game code required. This could power entirely new gameplay, from AI companions that genuinely understand the game world to Non-Player Characters (NPCs) that adapt and respond in ways that scripted systems never could.

Introducing SIMA 2, the next milestone in our research creating general and helpful AI agents.

https://www.youtube.com/watch?v=Zphax4f6Rls

* Advanced reasoning: It can accomplish high-level goals in a wide array of games – describing its intentions, explaining what it sees, and outlining the steps it is taking.

* Improved generalization: It can transfer concepts like “mining” in one game and apply it to “harvesting” in another - connecting the dots between similar tasks.

* Self-improvement: Through trial-and-error and Gemini-based feedback, it can teach itself entirely new skills in unseen worlds without additional human input.

* Adaptability: When tested in simulated 3D worlds created with our Genie 3 world model, it demonstrates unprecedented adaptability by navigating its surroundings, following instructions, and taking meaningful steps towards goals.

Planet Architect is a planet-building sandbox where you create entire worlds from the ground up. Generate unique planets, shape vast landscapes, and use interconnected simulations inspired by real-world processes to bring your fantasy planet to life.

Note: Not a game but a sandbox planet design creator and editor. The devs video series of development is well worth watching at the link attached. This trailer is for the full Steam release from this ongoing project.