People already keep their smartphones on table in busy bars, and maybe their wallet in a back pocket. This isn't any easier to steal than that, and has way less impact than having to freeze your credit cards for instance.
Much will depend on the price of the final Glass, but if it is down to around the price of designer sunglasses, I don't see a big threat.