Phones don't have GPS running most of the time, to conserve battery. GPS is turned on only while you use navigation apps or while tracking workouts.

So even if Google tracks you all day, they mostly have coarse data.

Fitbits main purpose is workout tracking, so they have a lot of precise GPS tracks. I suppose those have some value for Google.