undefined | Better HN

0 pointsjstanley7mo ago0 comments

I tried to make a custom Subscriptions view for YouTube but they kept blocking me for trying to scrape hundreds of RSS feeds.

0 comments

1 comments · 1 top-level

pbalau7mo ago

Maybe because their robots.txt disallows that?

    User-agent: *
    ...
    Disallow: /feeds/videos.xml
    ...

j / k navigate · click thread line to collapse