This is a really important point.
On the larger point, it's possible xenophobia is "natural", but I think it pays to be very cautious about what is "natural" or not among humans, what even that means. So so much is our social context. We can look at what social contexts (re)produce xenophobia and which don't without even having to decide what is "natural" though.