Heat is random movement. Infrared photons go in random directions, not the direction wanting to go. Some go in the wrong direction.

Reflection means solar sail goes in direction you want to go.