> worry about
I don't "worry" about it, as I don't care about karma and almost never flag anything, but most other users care greatly about their internet points (it is orange reddit, after all), and as krapp pointed out, it's long been suspected that using votes, flags, vouches in ways the site algorithmically dislikes or that moderators find adverse results in the equivalent of "hellbanning" of those functions.
For example, I still upvote or vouch comments that I feel were unfairly downvoted or flagged, and at least for vouching, it certainly seems like mine don't work anymore. I guess I vouched too many no-no things, and now I'm on the naughty list.
The fact that dang and the other mods engage in what's effectively a form of low-level gaslighting and deny doing so ought to be reason enough for any HN to dislike them, and yet all I see is fawning praise for the work they do.