The energy is dissipated as heat in the speaker coils. Energy is removed from the air. Think of it as using brakes to slow down a car. Yes, energy is consumed to do so (that's why the rotors get hot), but the car doesn't have 'hidden' energy, just because it was both accelerated, then decelerated. It really is at rest. The energy it embodied while in motion has been converted into other forms.