Not particularly. From the inside here and knowing people working on Brexit projects, there doesn't seem to be any plans to move people and businesses out of London. Certainly in the short term at least.
I'm more worried about the government and their IR35 reforms in the private sector to be honest.