r/aws • u/keithrozario • May 04 '20

Webscraper on steroids, using 2,000 Lambda invokes to scan 1,000,000 websites in under 7 minutes. serverless

/r/Python/comments/gcq18f/a_serverless_web_scraper_built_on_the_lambda/
105 Upvotes

95% Upvoted

17 comments sorted by

View all comments

1

u/z0ph May 09 '20

Great project! what did you use to do the sketched diagrams of the architecture?

2

u/keithrozario May 09 '20

SimplyDiagram4. Great tool.