> It's not that there is a history of discrimination
In abstract theory, that would be possible.
In concrete reality, with "colored people", there is, in fact, a history of discrimination, and when the context of use is not such that there is a clear separation from that history (a separation that exists in, e.g., the NAACP continuing to use "colored people" in its name) it has become problematic because of that history.
