After being frustrated to need to run headless chrome/selenium in my small scale scrapers because of Cloudflare and Akamai performing TLS fingerprinting. I decided to create a python library to use chromium's network library called cronet. If you don't need to run javascript and are only affected by TLS fingerprinting, using this library should be more efficient than pupeteer/headeless chrome.
The library was inspired by curl-impersonate(https://github.com/lwthiker/curl-impersonate) which solves something similar but by patching curl instead. I think the benefit of python-cronet is that it's going to be simpler to keep it up to date.
No comments yet.
