As someone born in Toronto, the weather is crap. You're right by a great lake, so it's damp/humid all year (step out of the shower and start sweating humid). Downtown is a series of giant wind tunnels, which isn't bad in the summer, but is downright chilly in the winter.
I moved to Calgary and the weather is great, nice and dry and Chinooks to warm you up during the winter.