undefined | Better HN

0 pointscurun1r4y ago0 comments

Eventually, but they’re not very aggressive when it comes to bot detection. Simple IP rotation usually works.

0 comments

I ended up having to put my search engine behind a CDN and CAPTCHA every new IP because I got something like 30,000 search requests like this _per_hour_ from a botnet. They seem to have backed off now but they were really quite persistent for a while.

j / k navigate · click thread line to collapse

0 pointscurun1r4y ago0 comments

Eventually, but they’re not very aggressive when it comes to bot detection. Simple IP rotation usually works.

0 comments

marginalia_nu4y ago

I ended up having to put my search engine behind a CDN and CAPTCHA every new IP because I got something like 30,000 search requests like this _per_hour_ from a botnet. They seem to have backed off now but they were really quite persistent for a while.

j / k navigate · click thread line to collapse