Property tax on residences isn't they only place municipalities get revenue, they also get taxes from commercial (shops & companies) property. If the foreign owners never move into the house and don't rent[0] it there is no additional revenue in the form of purchasing things or working at an employer in the city.
[0]https://www.pressreader.com/canada/the-province/20141127/281...