It is illegal when it comes to lending. See the section on disparate impact.

http://www.occ.gov/topics/consumer-protection/fair-lending/i...