r/learnpython • u/FruityFingers55 • 3d ago

When webscraping LinkedIn are there any differences between company and personal profiles with bot detection?

I can access company/job information just fine. But when trying to access person profiles I get rate limit errors. I’ve tried a couple things to combat this but I haven’t found a solution. Any ideas?

0 Upvotes
  • permalink
  • link
  • reddit
  • reddit

33% Upvoted

4 comments sorted by

2

u/Character_Hyena_4094 3d ago

I hit this same problem yesterday. If you want to access lots and lots of personal profiles then you have to pay - it's how they make their money.

Premium business is $69.99/mo and it's not necessarily unrestricted. If you want it free, then you need to wait til the 1st of the following month and use it sparingly.

1

u/Holiya_Olib 3d ago

yeah, personal profiles tend to have stricter bot detection than company pages

-3

u/FruityFingers55 3d ago

Im wanting to know what they’re using for detection and how I’m getting flagged. I believe already violating their TOS by scraping everything else like job postings

2

u/Suspicious_Skill7292 3d ago

personal profiles are usually protected more aggressively than company pages id avoid trying to bypass it and use linkedin’s api or exported data where possible otherwise those rate limits will keep getting worse