For one of our project we have built a HTTP proxy pool that inteligently routes the HTTP requests to a proxy server which accessed the target website host the least.
By doing this we can rate limit how much each proxy server in the pool can access specific website in a period of time to avoid abuse and ban.
I am thinking about extracting this part of the project as a paid service.
The service would be for companies that do a lot of web scraping, web data analytics and processing.
What do you think about it?
