Show HN: Save RSS items as JSON files with Python script (opens in new tab)

(github.com)

6 pointstrbznk4y ago4 comments

4 comments

3 comments · 1 top-level

account-54y ago· 2 in thread

I must admit I'm not seeing the point of this but it obviously has a use or you wouldn't have created it. I'm just recently trying to get my head around async in python, good to see some clear and understandable code involving it.

trbznkOP4y ago

For sure it's just a simple script. But I really like to play with news data in my personal NLP projects. So I had the idea to scrape the data by myself.

Some months ago I've implemented the same script with the requests library and complete synchron and the script took around 1 minute to complete. Now, after first time implementing HTTP requests with async it's finished instantly in around 1-2 seconds.

account-54y ago

Yeah I'm interested in async for the same reasons. It's still not clear in my mind yet but I'll get there. I'll definitely be using your script to make sense of it. I'm told web requests and file IO is a good place to use async.

1 more reply

j / k navigate · click thread line to collapse