Here's the difference: A camera in a hat is
designed to record people without their knowledge. Glass is designed to do other things, and, in fact, is terrible at recording people without their knowledge, because everyone knows it's a camera. It even has an indicator light to show when it's recording. It just happens to be possible to record people without their knowledge with it.
If anybody actually wanted to record people without their knowledge, Glass would be a terrible tool to choose, and many times more expensive than the alternatives, too. It's just not worth being that worried about.