As you imply, it is a very difficult question to answer. But isn't cultural variation often used to explain the advantageous social and economic position of Jews and East Asians in American society? And if cultural variation can explain this, is there some in principal reason why it cannot also explain disadvantage?
Again, I am not saying it explains all disadvantage that Blacks experience, just that I do not think oppression explains all of this disadvantage either.