Well by government I mean the agencies doing the surveiling. They'll of course insist and argue in court that it's lawful, I would hope judges say it isn't.
It's tricky because of the way airspace works with private property, its a very complex realm. It's different peering through their roof to see what they're doing inside, but just watching people outside might be considered not an unlawful search.