Modern ventilation hardware can reclaim between 85-95% (claimed, but tested and verified). You do not need to run it full power, just a constant optimized flow and only when people are actually in the rooms. I'm relatively sure that the cost is less than heating/cooling a poorly insulated house.