Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Linkedin is even worse, imo. Go to any random company page and it'll show you a page, asking you to login. Refresh it again and it'll show you the page, without asking you to login.


That is probably because LinkedIn Authwall algorithm is on A/B testing, they do lots of machine learning so that they stop bots, but mostly scraping Linkedin is quite impossible i would say even on small volumes




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: