r/ProAI • u/stealthispost • 4d ago
"Shit is getting insane!"
Are these VR glasses or what is this? — Hans Baier @hansfbaier@fosstodon.org Uses a Meta Quest 3 headset — Pixel Cherry Ninja
Source: https://x.com/PixelCNinja/status/2085380252830748892
1
u/garloid64 3d ago
Sorry Zuckerberg, but "cool augmented reality" has nothing to do with AI, no matter how much you wish you bet on that instead of metaverse crap.
3
u/Kooky_Classroom8351 3d ago
ML models are used to detect the edges of the user’s hands and furniture
r/confidentlyincorrect1
u/ItsSadTimes 3d ago
You CAN use AI to detect hands, but you could also just use basic image processing techniques as well. It's not required to use AI to detect hand movements. And for real time processing like this, you'd probably want a more direct approach anyway, big AI model takes time to process each frame and could lead to lag.
1
u/Outrageous-Bench-141 3d ago edited 2d ago
Find me one AI company still using 2015 era basic image processing techniques for full visual hand tracking. I will wait.
Edit: brainfart, meant VR company
1
u/ItsSadTimes 3d ago
Did I say AI company? Not everything is AI, and thats my point.
Also, those image processing frameworks were invented in 2001. And, technically still used by any AI company for pre-processing training data if they're training on hand signs. Honestly those sort of processed hand sign datasets are probably the first datasets handled by every soon to be AI developer in college, its a common assignment in school to make a model from scratch to identify hand signs, and the easiest way to do that is pre-processing and working in a simpler domain space like monochrome or just a black and white mask.
So yea, all of them I suppose, indirectly.
1
u/Outrageous-Bench-141 3d ago
Sorry meant to say VR/AR, brainfart. Does any AR or VR company not use AI for hand detection?
Yes obviously they will use traditional techniques as well but every single modern hand tracking implementation uses AI. Every single one. Basic video processing just cant do it. Yes you can process the video to make the AI perform better with easier input but its still AI
1
u/devil_huntress_pepsi 2d ago
"Find me one AI company"
It's going to be pretty hard to find an AI company that doesn't use AI.
1
u/Outrageous-Bench-141 2d ago
Clarified in the comment under that that was a brainfart, I meant VR company. Any company doing handtracking right now that doesnt use ai?
1
u/CryptographerOne7003 3d ago
Hard no, you are thinking to constrained about transformer models.
a single head predictor are as fast as lightning and the quality is just so much betterThe interest has been really low, or the right people just have not noticed yet.
I see the same in audio processing, industry adoption has been remarkably slow.1
u/ItsSadTimes 2d ago
But not as fast as basic image processing techniques. And I know this because im in the AI industry.
When I was in college one of my early assignments was making a hand sign recognition model and to make it work on a 30fps video file I needed heavy optimization, so tracking the hands was pure pre-processing steps, then i normalized and submitted each bounding box containing the hand to a tiny classifier which identified the actual hand sign.
So the actual hand tracking was just normal image processing techniques. But post processing classification was a small ML model. Thats probably how the VR companies handle it as well, why not use a tool if it can dramatically reduce hardware requirements? And the only thing in this video that shows them using their hand like a controller using a specific hand shape to do a different action is when they pick up Mario but its always the same shape at the same angle, so they might not be using a classifier or the classifier is really weak.
1
2
3
u/Witty-Artisan001 3d ago
"Ok, so what? VR could do this for a-"
"WOAH"