undefined | Better HN

0 pointsAznHisoka8y ago0 comments

Yep, I know, but that means if I am writing the crawler in Ruby/Python, this is not something I can do, right?

0 comments

1 comments · 1 top-level

Yes. The crawler can be written in nearly any language. The actual scraper probably has to be written in JavaScript in order to access and interact with the DOM as the user would and thereby gain access to content that is not present by default.

j / k navigate · click thread line to collapse