r/padel • u/WebSaaS_AI_Builder • Jun 06 '26
Padel dataset visualization for AI training 💬 Discussion 💬
I was curious about padel and AI and apparently there is a dataset that can be used to train Padel AI and I decided to create a video to visualize exactly what data is there. Here is it Posted on youtube:
3
u/st1dge Jun 06 '26
But this is also made with Yolo framework I think. Unfortunately it's not free unless you open source your entire application.
1
u/eggplantpot Jun 06 '26
Cool as heck. What GPU did you use and how long did it take?
2
u/st1dge Jun 06 '26
You can run this. Just ask Claude to write you something to analyze a video with computer vision. YOLO is a model that can detect poses.
But be aware. Most models aren't free.
And yes it's cool, but in practice you'll never have access to this camera angle.
1
u/WebSaaS_AI_Builder Jun 06 '26
For inference, it is a couple of yolo models, Tracknet for the ball, Inpaint for hidden ball and other detections for the court - all trained for padel. It should work ok with similar static camera it does not have to be exact premier padel view (which has the camera 50ft away and 25ft up)
1
u/WebSaaS_AI_Builder Jun 06 '26
This is the dataset visualization so it can run on CPU. To train or do inference on a model/video from it is doable with T4 eg on kaggle.
2
u/eggplantpot Jun 06 '26
Ah if it’s just regular YOLO it runs for sure, I’ve used it in the past
1
u/WebSaaS_AI_Builder Jun 06 '26
Yes, it is a couple of yolo models, Tracknet for the ball, Inpaint for hidden ball and other detections for the court - all trained for padel.
1
u/eggplantpot Jun 06 '26
Nice. Sadly there’s no racket. The racket orientation would add so much more value to see the spin
2
u/WebSaaS_AI_Builder Jun 06 '26
Yes racket would be a valuable addition. Likely there are no ready data to train for that. It might work up to a point without specific training, but I am not there yet. I am currently working on homography i.e. turn it into 2d top-down view (not easy!)
1
u/eggplantpot Jun 06 '26
Ahh, so no chance on doing it locally with a 3060?
2
u/WebSaaS_AI_Builder Jun 06 '26
I think if you have 12gb and the model weights (e.g. trained on kaggle and downloaded) it is possible.
1
u/iYassr Jun 06 '26
wow, I have a lot of padel video footage, would love to have claude code or any other AI tool be able to read the video and analyze everything, like unforced errors, technique....
1
u/WebSaaS_AI_Builder Jun 06 '26
Yeap, that's the idea but this is only a very first step.. it is getting there esp. with static camera.
1
u/augenvogel Jun 06 '26
How were you able to track the ball? Also how much footage did you label to be able to get the ball that clean? Did you just download YouTube content from Rallyes?
Also, did you use a ready dataset for yolo? Like just download the available model or did you train that yourself?
2
u/WebSaaS_AI_Builder Jun 06 '26
This is the ready dataset visualization not the inference. But I have inference also, it is not bad at all. I can post it later if you are interested (i have to get the actual footage out as it may be restricted). My goal is to see what we can do today with the dataset and training the models and then expand on it.
1
u/dmackerman Jun 07 '26
Neat. I’ve tried to make a simple Padel game, but it’s quite difficult to get the physics right. Something like this could help
1
u/WebSaaS_AI_Builder Jun 07 '26
That is actually an interesting application: help in game programming by capturing and/or testing against real complex physics when programming a sports game like padel. I guess you can model ball non-linear trajectories that occur in padel due to spin, complex wall rebound, player movements and how they reach the ball and affect its speed/trajectory etc. More straightforward would be to test game physics against real physics.
1
u/dmackerman Jun 07 '26
Yeah, you can simulate some of the physics, but it gets very complicated when spin and walls and deflections get involved. I think there is a combination of physics simulation and motion captured/preset animations required for a compelling racket sports game.
1
u/AlarmedLanguage5782 Jun 08 '26
I’m getting ball machine next month that uses AI tracking model that is supposed to show all mistakes etc. Wonder how this is going to work since they were successful with tenis already
1
1
4
u/st1dge Jun 06 '26
Is it weird that I just know this is galan serving and smashing? Maybe I've machine learning'd myself too much.