> Racial categories are based on a very small number of superficial traits
Right, but genetic correlates are real. These superficial characteristics evolved along with a thousand other non-superficial characteristics, in mostly (with the exceptions of conquest, trade, and border settlements) isolated regions.
Your skin tone and eye shape are indeed cosmetic trivialities, but they correlate strongly with muscle fiber density, susceptibility to certain diseases, endocrine profiles, and a host of other things that very much do matter.