Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

When I saw this service last week, I think you had a section about a paid service where you do the scraping on a server and send the results. Do you offer that? How do you get around anti-scraping technology, if it exists?


Yeah, that's offered although it's currently free.

No particular tricks to avoid detection. It's Puppeteer under the hood with a few customizations which works well on the majority of sites tested so far.

Given the cat-and-mouse game around web scraping you may never cover every website, and that's ok.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: