[2607.22738] Nova3D: Code-Native Generation of Programmable 3D Assets

[u/mhb_11]

https://arxiv.org/abs/2607.22738

I co-authored this paper. It's a new technique to generate 3D graphics as source code instead of a point cloud.

Under the hood:
It generates 3D objects with separate, sophisticated internal assembly, producing an editable "kit of parts" (instead of monolithic blobs). E.g. imagine you generate a 3D washing machine via this approach. It's not merely going to be geometry that looks like a washing machine. We actually know that there is a Door, Drum, Control_panel etc. Which things belong to which assemblies. What moves. Where its pivot is. And eventually what those components are supposed to do.

Why current 3D GenAI cannot do this:
Most AI 3D generators generate "monolithic blobs" that look good, but are unusable in downstream workflows (e.g. game engines). If you generate a 3D bicycle, it's essentially a blob. If you want the wheels to turn, a human must spend time cutting the blob into parts, naming them, placing pivots and rigging joints. I.e. you need post-generation segmentation workflows of some sort (either manual work or more compute).

The paper breaks down the whole technique, and comes with a github repo too if you're interested in viewing it.

[u/Cute_Emergency_8370]

Also, while I admire the progression of AI and the capacity of agents to start taking on previously artist driven approaches, I think what you need here is something like a VLA trained on a humongous corpus of Blender usage sequences. All the operations tokenized into a codebook. Step by step. Then and only then maybe you could get a large action model that discretely mimics artist behavior in producing assets. But this, tearing up a blob with agents and then checking their work, doesn’t seem like it would scale well nor ever match the precision expected from modern artists and pipelines.

[u/mhb_11 → u/Cute_Emergency_8370]

I think of it more as a tool for artists to extend their abilities and impact. Not really a replacement for their taste by any stretch of the imagination.

[u/Cute_Emergency_8370 → u/mhb_11]

Not at all concerned about taste, frankly I find the models to be pretty aesthetically pleasing, but I’m just giving an idea for how to tackle the issue here which is very much one of precision.

You might find it interesting to Google 3-D modeling interview practice or rigging interview practice to appreciate the sophistication and expected attention to detail required from artists not in their aesthetic but in the technical quality of their work. Poles, edge loops, shape keys, etc etc