can I run feedity over news.yc? or turn the news.yc site to rss. I gave it a go but couldn't get a result. It would be useful to try because it's a pain scraping lots of different nyc pages.
... try again. Ahh now I got it. The first time I didn't select a category. Is it possible to get an rss result back without selecting a category? (like select your own?) as the categories restrict (reduce the returns). I want everything back.
... now I understand. I've tried to do something that's only found in the "Advanced Refine" menu. Would it be a good idea to add an "Advanced" link at the front page?
... aggh the Advanced Refine cr@ps out on my blocks. I'm trying this bit because I've been hacking with BeautifulSoup pretty much doing exactly what the refine is doing. Its an absolute pain. One idea to make selection of the blocks easier is to parse the html doc, then render the structure as an outline visually (like HTML Validator or below) .... table tag
+ td child tag 1
+ td child tag 2
+ tr child 2,1
When I was trying to parse pages the ability to see the page + markup overlayed with the structure HTML Validator ( https://addons.mozilla.org/firefox/addon/249 ) made it 10 times easier for me to select exactly "what" I wanted to parse.