I got round it by just making sure the user agent is set to the latest version o... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

londons_explore on Nov 5, 2020 | parent | context | favorite | on: Facebook was used as a proxy by web scraping bots

I got round it by just making sure the user agent is set to the latest version of Chrome rather than a version from a few years ago that I had hardcoded before. It seems Cloudflares protection is pretty much "is your user agent in the top 10 user agents?".

Did you try that?

cblconfederate on Nov 5, 2020 [–]

I have, iirc it worked some times, but not always. Is it a reliable solution for you?

londons_explore on Nov 6, 2020 | [–]

It's at least a 95% reliable solution, which seems to be about the same as a real user sees.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact