“Google is wrapping knowledge up in answer cards and not sending traffic” (opens in new tab)

(blog.sweetiq.com)

4 pointslandtco11y ago4 comments

4 comments

4 comments · 3 top-level

walterbell11y ago· 1 in thread

Is there a generic list of defense techniques against scrapers, including but not limited to Google? E.g. move some content behind a login wall?

landtcoOP11y ago

In theory, you can disallow crawlers and bots via robots.txt. It's not a hard defense per se because crawlers can ignore it.

landtcoOP11y ago

Interesting, but the title is confusing. Better to use the original in this case.

j / k navigate · click thread line to collapse