This is why paparazzi exist and how they operate. It's the dirty, dingy cost of having a free press, freedom of travel, freedom to hold public officials accountable, subject to the same laws you are; you can't waffle or restrict or grant exceptions, because those inevitably, invariably get abused by those in power.