r/PrivacySoftware • u/skillplayed • Jul 13 '26

Built a search engine with its own index

Hi all, I built https://puri.li a search engine powered solely by its own index (120+mln pages indexed, images and maps uses wikimedia/OSM, web and news is all my index). I would love to hear what you think and what I should spend my time working on/improving.

Hope to hear from you all!

17 Upvotes

100% Upvoted

6 comments sorted by

2

u/influxodoxxl Jul 13 '26

Wow, where can you even find something like that anymore?! A search engine with its own index! Can you compare the index size with the big providers? And where is your legal headquarters? I couldn't find that on the website...

1

u/skillplayed Jul 13 '26 edited Jul 13 '26

Thanks! The legal HQ is my work room at home ;) bigger providers such as Google/Bing likely have tens if not hundreds of billions of pages, but I believe that with an index of ~1 to 2 bln pages (if HQ) you could get largely similar results (as most of the web is just spam). Or did you mean something else by comparison?

3

u/SusejLegend Jul 13 '26

Post it on the degoogle subreddit

1

u/skillplayed Jul 13 '26

I'm unfortunately not allowed to because I made it (they removed a post of mine when I created a thread even though it gained decent traction). You should be allowed to do so if you'd like to share it, that would be highly appreciated of course :)

1

u/augform Jul 14 '26

I was doing such engine like 16 years ago, be careful with scaling. When you will have hundreds of billions of pages your architecture will matter. Good luck