undefined | Better HN

0 pointsgettodachoppa2y ago0 comments

Youu want the monopolistic tech giant to crawl you but not a small privacy-focused company? What possible justification could you have for this attitude?

0 comments

lern_too_spel2y ago

If you want your robots.txt to tell bravebot to crawl your site but not googlebot, Brave puts you in the same position. You can't.

What possible justification could Brave have for this policy?

j / k navigate · click thread line to collapse

0 comments

lern_too_spel2y ago

If you want your robots.txt to tell bravebot to crawl your site but not googlebot, Brave puts you in the same position. You can't.

What possible justification could Brave have for this policy?

j / k navigate · click thread line to collapse