Ask HN: How can you recursively grep a website?

1 pointswolfparade14y ago3 comments

I want to use a regular expression on a whole domain. What is the easiest way to do that?

3 comments

3 comments · 2 top-level

saiko-chriskun14y ago· 1 in thread

yep either just use google, or download the site as mentioned and use:

grep myTerm path/to/mysite/

hm looks like ycombi parsed out my asterisks. at the end of the path should've been two.

Google's site: operator... or write a crawler to parse all within-site text links, download the site source into files on your machine and then grep.

j / k navigate · click thread line to collapse