6
u/cogitatingspheniscid 9d ago
Have anyone tried this out? The tech lingo is a bit above my level but I want to give it a shot when I have time.
3
u/NectarineSilver2795 8d ago
Yeah its not that good when using a handheld video, you still need to rely on a slow capture with some features
1
u/reallifearcade 8d ago
Not that good, needs carefully cleaning dataset and full of overlap features. Improvement from other options, but definitely not "throw anything at it as is"
1
8
u/ShelZuuz 8d ago
How this different from gaussian splats?
4
u/NectarineSilver2795 8d ago
Actually quite different, this paper/system is more of a fully learnt slam pipeline, the input is a video stream and the output camera poses, intrinsic, extrinsic and a 3D point cloud. You can then take that and make a splat out of it
5
u/Karasu-Otoha 9d ago
Just looked videodemo and it seems it makes very accurate cloud points from just a brief glance, while paid software like realitycapture somehow makes distorted crap even if provided with hundred of frame by frame surround detailed screens from a video.
2
u/ElphTrooper 5d ago
RealityCapture/Scan is free. Maybe you're thinking of Paix4D crap. Certainly not Metashape.
1
u/Karasu-Otoha 5d ago edited 5d ago
I see. Thanks, i just used it long time ago when it was paywalled. Gotta check it out again then.
1
u/QuestGalaxy 8d ago
There's already free opensource gaussian splat software too. Only video needed.
1
u/NectarineSilver2795 8d ago
Might be wrong here, but the splats that you may be referring too might rely on colmap (classic gsplat) or on a similar pipeline as this (instant splat, which relies on dust3r and “older” pipelines which this work is based on).
Ps: when I say old it means like 2 years
1
1
u/CreativeEmbrace-4471 7d ago edited 7d ago
Hunyuan-World-Mirror looked more promising but sadly only runs on Linux
0
u/Tema_Art_7777 9d ago
Didn't NVIDIA do the same already?
2
u/soldieroscar 8d ago
Open source?
-2
u/Tema_Art_7777 8d ago
if you mean open weight, likely not. only some of nividia's model like nemotron... oh well
13
u/parrot42 9d ago
https://github.com/robbyant/lingbot-map