Which is, in fact, what happens. Solar sails exploit this fact:
https://en.wikipedia.org/wiki/Solar_sail