Such an engineer's solution. :P
The glaring issue here would be standardization. Either every place uses the same sounds, or you have to learn a new system for each place you visit using this sort of thing. This is also why you couldn't change notes regularly, which would be boring and repetitive for everyone else.