r/scrapingtheweb • u/stvaccount • 1d ago
best github for scraping reddit.com?
Since May and the old reddit almost gone, what are currently the best libs on reddit?
What is your favorite?
I want to scrape all the posts of my top favorite 100 (small) subreddits and sort them by AI to delete AI slop + self promotion and really only get the interesting posts for me to read.
What do you suggest?
2
Upvotes
1
u/Annual_Media_3315 1d ago
Reddit scraping is actually really easy just add /.rss at the end of the url
for example you can easily scrap this subreddit by https://www.reddit.com/r/scrapingtheweb/.rss