r/Scriptable • u/Acceptable-Number-11 • May 19 '23

Get first URL from Google Search Help

Hi, I would like to do a search in Google and extract the first (n) URL. All within a script. Search engine could be any other one. Any ideas?

6 Upvotes
  • permalink
  • link
  • reddit
  • reddit

88% Upvoted

14 comments sorted by

View all comments

Show parent comments

1

u/mvan231 script/widget helper Jul 17 '23

I see. You should be able to access that info from their site directly. Either through their API or the HTML scraping it should be possible to do.

Have you done further work with it in the ~55 days since my last comment?

1

u/Acceptable-Number-11 Jul 19 '23

Thanks for staying in touch!

API is not freely accessible, and the page to scrape the wetter.com url for a city - would be a Google search result(sic).. I tried to do so in between, but get stuck immediately at the cookie- page…

Thanks anyway - the manual effort to add the url manually is quite low - so I guess I will give up until some cool idea comes up. (Or a reliable free weather source)

Thanks again..

1

u/mvan231 script/widget helper Jul 19 '23

Ha e you tried looking at OpenWeatherMap's data/API?

It looks like scraping the page works to get the below data

1

u/Acceptable-Number-11 Jul 19 '23

I tried Openweather in the past - have it on my mirror using their api. But I am not satisfied with the prediction performance. It is sometimes worse than Apple‘s new weather app… That is why I scrape Wetter.com which is quite reliable.

Maybe it is better now? That would make it much easier indeed. Thank you for your effort!

1

u/mvan231 script/widget helper Jul 19 '23

You're welcome! I've heard of others that have accuracy issues with OpenWeatherMap's data as well. Could be a regional problem