Skip to content
Better HN
Top
Best
Ask
Show
New
Jobs
Search
⌘K
0 points
mimsee
5y ago
0 comments
Save
Share
Because wouldn't they have to keep adding new techniques to the list continuously when in the other case they can say in what format the content needs to be available in.
0 comments
1 comments · 1 top-level
top
newest
oldest
pseudalopex
5y ago
Indexable is open to interpretation. No disallow directives in robots.txt isn't.
j
/
k
navigate · click thread line to collapse