undefined | Better HN

0 pointschinathrow10y ago0 comments

They do this via an iPhone like UA, though googlebot is still in there too.

0 comments

2 comments · 1 top-level

eli10y ago· 1 in thread

I'm pretty sure that's just to see if the site is serving different content to mobile vs desktop. I think they also sometimes hit pages with no mention of googlebot.

x010y ago

If you do an nslookup on the IP, it should come up with crawl-xx-xx-xx-xx.googlebot.com, where xx-xx-xx-xx is the IP.

j / k navigate · click thread line to collapse