I think so! I think the trick is to allow users to use it from the youtube.com site -- make it really really easy to rate videos.
You almost want some form of bot that posts a comment on users video page if they're rated x times ("your video has been ranked on skuttlefish - the most popular part is y, and the least popular is z - rate this video here")