this doesn't really matter though, because you still now the meaning of the Emoji. Letters also render different, depending on the font, without their meaning changing
This is not true. The actual form has meaning too. Extreme example: if someone sends a romantic message, they typically don't want it rendered in a font typically used for the title on a horror DVD.
