Indeed, in both cases, it's perfectly normal for the other person to do this! So attempts to bring attention to it will be fruitless. The "ignorant" person will see nothing out of place, and will be bothered by the to-them baseless accusation, and the "malicious" person will be threatened by the realization, so they will try to sweep it back under the rug.