That's exactly how my project
https://linklonk.com works.
When you upvote an item, you connect to other people who upvoted that item. When you downvote - you disconnect from those who upvoted it. So those who upvote useful content for you, get more weight in your recommendations.
Coincidentally, I'm doing a show HN post for it today: https://news.ycombinator.com/item?id=28405643, so will be happy to answer any questions there (instead of hijacking this post).
OP, does EvalRSS list content in reverse-chronological order? Any plans to prioritize content? What I do with LinkLonk is: the more items for a feed you upvote - the more other items from that feed are prioritized. Also, RSS readers have a notion of read/unread status. What are your thoughts on that? Is reverse-chronological ordering supposed to help the users distinguish unread content from read content?
Consider adding the number of comments each item in the list has. I added a test comment on https://www.evalrss.com/comments/9dcbaacb-96b7-4eec-8959-ba6... and there is no indication of that comment in the list.