undefined | Better HN

0 pointskarn971y ago0 comments

Why not just rate limit every user to realistic human rates. You just punish anyone behaving like a bot.

0 comments

2 comments · 2 top-level

Because, as pointed out in another post about the same problem: Many of these scrappers make one or two requests from one IP and then move on.

Sold. Pay by page retrieval rate.

j / k navigate · click thread line to collapse