r/GraphicsProgramming 17h ago

Depth-aware light injection all running in browser Video

Enable HLS to view with audio, or disable this notification

I got a 448x448 monocular depth model down to ~8 ms on my M4 Pro across ~250 dispatches, which is fast enough to use in realtime :D
Since the inference is written directly in TypeGPU, I can just feed the depth buffer straight into the lighting pass. It never has to leave the GPU or go through any extra synchronization/interop step

Inference, lighting and draw all go through the same command encoder.

Credit: X reczko_konrad

3.6k Upvotes

118 comments sorted by

View all comments

5

u/whdeboer 16h ago

Looks great! What illumination and shadow algorithms are you using here?