Speculation, which would not be allowed in a court of law, is unfortunately a perfectly acceptable character assassination methodology.
And this kind of tar-and-feathering is precisely why we need official processes for this sort of thing. Official reprimands leading to termination if unfixed, like all civilized peoples do. This ensures that it's made crystal clear what's acceptable and what's not, with time to mend one's ways. The alternative is arbitrary terminations, which makes everyone insecure.