You don't get to take advantage of structural discrimination and then whine about how hard it is to have to treat people fairly. If that's a problem for a bank then they should find another asset class to invest in.