Exactly. One of the people I'll always point to as evidence that race is a social construct is Barack Obama. He was the "first black president". In reality he is, genetically, as "white" as he is "black". We still call him black because of the color of his skin.
If people insist for long enough that racial categories are inherently biological you'll eventually end up in one-drop judgement territory. Not a great place to have a discussion.