Racist stereotypes aren't insidious and vile because they have no truth to them. Most stereotypes are based on reality, and some even apply to the majority of the stereotyped group.
The problem with stereotypes is that you're lumping people together in possibly negative categories only because of their race. That's scientifically unsound and harmful to the individuals who want to (and should be) considered individually without prejudice based on their race.