It's because you don't know them well enough. Or maybe because you haven't been "formally introduced". This makes you nervous of the impact that an accidental disclosure of information might have.
Invite them around for a BBQ (if you're American).
Even better, if you notice one of them having a minor problem, offer to help with it.