Not quite following this argument. The distance between the microphone and speaker is fixed (and small compared to the wavelengths of interest) because they are part of the AirPod.
Assuming the the canceling wave is timed to cancel at the speaker this should not matter as the external wave and the canceling wave would have the same distance to the ear drum.
