However, they sometimes offer a "try anyway"-link and sometimes not. The times that I can not easily "try anyway" makes me dislike Google much more than the times that I "try anyway" and it ends up broken in funky ways.
Bottom line; Yes, your reputation suffers when users encounter issues. Your reputation also suffers when users encounter the big blocking issue of not being welcome at all.