The problem is you now need some actual structure rather than just some thin sheets / inflatable structure or whatever. Further applying even small amounts of force across huge sheets adds up while as you say it's acting like a solar sail.
That is to say it's clearly still possible, just not as cheap as people are assuming.