You are missing the point. He said why he downvoted you and you replied with a general rationalization on why he should agree with you, when that's entirely NOT the point. You'll catch more flies with honey than you will with vinegar. We probably all agree with you in some fashion, just not the way you put it.
And, just in case YOU can't figure it out, the blaming statements you are making are due to the use of 'you' in your comment.