Were that the case, “literally” would not literally mean both itself and its opposite.
https://www.merriam-webster.com/grammar/misuse-of-literally
Words change meaning frequently throughout history, depending on how they are (mis)used. Or they can change meaning depending on context or part of the country/world.
https://www.vox.com/2015/11/29/9806038/great-british-baking-...
Sometimes drastically.
https://www.reddit.com/r/TooAfraidToAsk/comments/kc41mu/why_...
> Otherwise, they are not an aid to communication.
I do agree with you that it makes it harder, but communication does depend on more than just the words.