Nah, it's just not that clever.

Or they just don't think the comment brings much to the discussion.

I think that removing the downvote button altogether is a good idea on this site.