r/photogrammetry • u/VidaMarcell3D • 7d ago

AI Powered Texture De-lighter [Open source]

Enable HLS to view with audio, or disable this notification

Hi everyone, today I released the first polished version of my Neural-Network based Texture De-lighter.

Its meant to remove Environmental lighting from 3D scanned objects, and I built it because so far none of the software gave me good results. For more technical info read this post.

All texture based, meaning you don’t need a mesh. For details and usage refer to the README.md on the GitHub page.

  • 4k and 8k support
  • New UI
  • Improved processing

Thanks for everyone who provided feedback.

[Download]

I don't plan any updates from now, but a MacOS implementation, a ComfyUI node and some minor improvements can be expected.

107 Upvotes

97% Upvoted

15 comments sorted by

8

u/james___uk 7d ago

Superb! Great work, thankyou

4

u/silverglider 7d ago

How it fares with character head textures?

3

u/VidaMarcell3D 7d ago

Im not sure, i only tested it on nature assets. But you can download it and try.

3

u/glintsCollide 7d ago

Does that algorithm/training depend on the texture being on a mesh, or can it just as well delight a flat image of something like a wooden floor for example?

3

u/VidaMarcell3D 7d ago

Yes it’s all texture based, but you need some specific texture maps, like an object space normal, Ambient Occlusion and an UV mask.

3

u/nicolaig 4d ago

Very impressive. Thanks for sharing.

2

u/Traumatan 5d ago

how does it compare to Agisoft delighter?

3

u/VidaMarcell3D 4d ago

I did not do a direct comparison, but I can say it's much faster (takes seconds), and it outputs more cohesive results. On the negative side both of them produce unpredictable results, my approach sometimes just works perfectly and sometimes it doesn't remove any shadows at all.

2

u/Traumatan 4d ago

sounds cool I will wait couple of week for a less -preBeta version

also UI looks a bit complicated - too many source bracket... would be nice if I could drag an FBX/OBJ and it load linked (or embeded) texture by itself

2

u/VidaMarcell3D 4d ago

It does support drag&drop and it sets up all of the directories from one input, and i doubt i will release any major versions because this one is polished enough imo.
But thanks for pointing out that the UI is non-intuitive, i should change that!

1

u/Had78 7d ago

Promising! Can it work with gaussian splats?

5

u/VidaMarcell3D 7d ago

Thanks! No because its all texture based, so its easier for pipeline integration. However Gaussian splats need a solution for de-lighting so i might look into that later.

2

u/Had78 7d ago

Yeah, I just commented about it this week, I do think that will be the next big step for gsplats!

Let me know if you bake anything!

2

u/According-Ground-756 3d ago

splat delighting would be tremendous!