I don't think, and I absolutely don't think not joining a party would make one's interaction with another person unpleasant. I have seen both types. My old boss doesn't go to party much, but he's absolutely the easiest person to work with.