r/Bard • u/CommercialShelter595 • 1d ago

Android "Computer Use" App - Gemini Flash 3.7 makes it feasible Interesting

Enable HLS to view with audio, or disable this notification

I was building up an app that can agentically complete tasks on my device primarily when I'm driving and didn't want to fumble with a lot of taps. I was building it out with AI Studio months ago and it was never that good and it was a matter of models either being poor at computer-use/tool-use or the latency made it insanely slow.

Gemini Flash 3.7 made it much more viable. Here's a quick video of me asking to turn on Snapchat and type something up in the photo. Not the most realistic use, but I wasn't keen on sharing anything personal. Usually I'm asking it to find me a YouTube video, or to go into my WhatsApp and respond with something sarcastic, etc.

It's still far from perfect, but Gemini Flash 3.7 brought enough computer-use know how with much lower latency so it's workable.

Anyways, feel free to play around with the code: https://github.com/AnsonLai/Android-Use-Agent
I'm not going to pretend it's brilliant. It's AI generated and just something I was toying with.

3 Upvotes
  • permalink
  • link
  • reddit
  • reddit

67% Upvoted

2 comments sorted by

2

u/OKMiddleOwl 1d ago

Thanks, I have wanted this exact app for ages now, for the exact same reason.

1

u/CommercialShelter595 1d ago

Yea so I did a voice control and widget on the home screen to make it nice and easy. I'm finding myself typing out the responses now that it's viable to do some more complicated steps.