undefined | Better HN

0 pointskayoone8y ago0 comments

I wonder if any of the crawlers in the world care. What a ridiculous thing to put on a website on the public internet.

0 comments

Seeing as how they don't have a robots.txt, probably not.

j / k navigate · click thread line to collapse

0 pointskayoone8y ago0 comments

I wonder if any of the crawlers in the world care. What a ridiculous thing to put on a website on the public internet.

Seeing as how they don't have a robots.txt, probably not.

j / k navigate · click thread line to collapse