SF has it's "the coldest winter I ever spent was a summer in San Francisco" days in the summer and its share of grey and damp in the winter. On the other hand, it doesn't really get the heat that the valleys can get so it's a tradeoff.
I live in a northern snow state and, other than the relative lack of seasons, SF city weather seems pretty nice to me and not even obviously worse than the South Bay.