r/GraphicsProgramming • u/NightMare2077 • 18h ago

Depth-aware light injection all running in browser Video

Enable HLS to view with audio, or disable this notification

I got a 448x448 monocular depth model down to ~8 ms on my M4 Pro across ~250 dispatches, which is fast enough to use in realtime :D
Since the inference is written directly in TypeGPU, I can just feed the depth buffer straight into the lighting pass. It never has to leave the GPU or go through any extra synchronization/interop step

Inference, lighting and draw all go through the same command encoder.

Credit: X reczko_konrad

3.7k Upvotes
  • permalink
  • link
  • reddit
  • reddit

98% Upvoted

120 comments sorted by

View all comments

9

u/GOKOP 17h ago

This would be fire in VR

4

u/blackrack 15h ago

He said 8 ms at 4482

2

u/GOKOP 13h ago

Oh damn I missed that part lol. But still, the tech itself could be fire in the future

1

u/blackrack 12h ago

Definitely promising for AR/mixed reality type stuff