The problem is that "intellectual debate" often ends up just being thinly-veiled excuses for why it's ok to discriminate against the marginalized group. It's kind of like how "intellectual debate" about phrenology was used to justify attitudes about different races.