That makes sense. Though I imagine that depending on where your CO2 sensors are, it could take a while for higher concentrations to reach the sensor, and then more time for the concentrations to go down once the fan starts spinning.
One of the reasons why mine also runs when I'm away is that it helps prevent mould growth in the heat/moisture exchanger, as that thing is a bit of a pain to clean.