Confiscatory taxes on the wealthiest would bring in hundreds of billions. That's not "very little impact", the money could be used to massively improve the lives of millions.
Yes, there are few people, numerically, in the top 0.01%, but that doesn't mean their taxes are inconsequential. Otherwise you might as well argue that they should pay no taxes at all. Absurd.