There's probably many reasons but one that comes to mind is, if I'm first am I an ambassador for my race now? Probably. The people here might be self selecting in other aspects of their life so they may not actually be around PoC anywhere else.
Another aspect is that I don't have that shared connection or ease of relating to people in the group. The activity has obviously selected for a specific group and there are probably other aspects of their lives that are also different from my own.
Past experience mostly. Trying to make friends where the majority is white was difficult though I was in university and far more awkward then. One on one or in smaller settings, its easier and at work it's relatively straightforward to become friendly with anyone.