There are downvotes and flags. People with at least 750(?) karma can downvote comments, so long as they are less than 24 hours old. No one can down vote submissions.
If a submission does not belong on HN you can flag it. Be cautious with flagging because you can (apparently) lose flagging privlidges. (I think I flag too many submissions and I have cut back on that. I think I flag comments carefully).
You can flag individual comments by clicking the [link] link which should then provide an option to flag.
There have been some discussions and guidance about the difference between downvoting and flagging but I can't find them at the moment. (But if you do get downvoted it's nice to remember that some people use it to express disagreement).