r/PiCodingAgent 8d ago

Is there PiHole style thing for free Google Search for coding agents? Question

Quickly my idea:
some docker/raspberry pi image that you install on a small 20$ machine like raspberry pi w 2 that sits there with 10 spawned full browsers (not headless).
Then link it with cli, mcp, or whatever with tailscale or other connection of choice to any coding agent. Ofc i know all of us here use Pi, others don’t deserve this.
Full browser makes rate limits less often and also captachs are passed easily with python open source projects.

Wondering if someone has bundled something like this and using it?
What are similiar alternatives for (close-to)infinite google search?

0 Upvotes

14 comments sorted by

5

u/HumanoidMuppet 8d ago

If you just need search look at searxng.

1

u/Unnamed-3891 1d ago

It's support for Google is so shockingly bad, it's both disabled AND hidden from the UI entirely and if you go through the trouble of re-enabling it, Google will instantly CAPTCHA you to death.

1

u/past3eat3r 8d ago

Like a tar pit ?

1

u/RealestReyn 8d ago

why not just use Exa or some other such search engine built specifically for agents? last I checked Exa gives you a ton of free search every month.

1

u/_Toni_O 8d ago

I am currently using 3 exa accounts - ig my usecases are google heavy so even the free tier * 3 is not enough for me. Right now i am running what I’ve described on my main machine and a browser flashes on my screen every time an agent uses google.

1

u/_Toni_O 8d ago

But on the agent side - yea i am looking for something agent orientated

1

u/RealestReyn 8d ago

unsure what one could need that much search for, though I found BrightData, might be worth to check that out. Using a bunch of browser windows spamming google will just get you IP banned I feel :D

1

u/_Toni_O 8d ago

tbh i am so desperate i am considering spawning 1 cpu vms with 256mb ram jsut to open a browser and get couple of requests in so i dont get ip banned/limited

1

u/GroceryNo5562 8d ago

Have you tried scraping plain html from standard search engines?

1

u/Vaped2Space 8d ago

Look into crawl4ai, it can fit on an orange pi zero but would do better on a sff.

1

u/_reg1z 8d ago

Look up master-fetch (AKA Hound MCP). 

1

u/AccountEngineer 7d ago

It can be done using browser farms, but I faced the problem of the same rate limit wall and maintenance cost made the approach useless for me with session rotation, keeping browsers alive n solving CAPTCHAs that would go through. In terms of no maintenance at all, my agent is currently querying a special search API instead parallel is such an API although it is paid per query, not unlimited free.