This turns out to be not pedantic but very important if you're guiding an ICBM. And when landing on the Moon, Apollo had to deal with irregularities in the Moon's gravity due to mass concentrations, called mascons.
(If you're interested in missile guidance, take a look at the book Inventing Accuracy. Among other things, it discusses some of the efforts to map the Earth's gravity field to increase missile accuracy for Trident and Minuteman missiles. I knew a physicist who worked on this.)