undefined | Better HN

0 pointsoblio3y ago0 comments

What? That's crazy! Does Github block indexing?

0 comments

> we have also introduced an x-robots-tag: none in the http response header of Wiki pages

> Abusive behavior in Wikis had a negative impact on our search engine ranking

> GitHub is currently permitting a select criteria of GitHub Wikis to be indexed

I don't see anything here about wiki specifically but maybe one of the rules hits wiki pages?

They've moved from robots.txt to blocking by headers.

j / k navigate · click thread line to collapse

> we have also introduced an x-robots-tag: none in the http response header of Wiki pages

> Abusive behavior in Wikis had a negative impact on our search engine ranking

> GitHub is currently permitting a select criteria of GitHub Wikis to be indexed

I don't see anything here about wiki specifically but maybe one of the rules hits wiki pages?

They've moved from robots.txt to blocking by headers.

j / k navigate · click thread line to collapse