The point about white noise is that an open office should have about 45db of background noise (white or pink). This means that a person is less likely to hear a normal voiced conversation 20 feet away.
What makes noise distracting is that it stands out from the background (just as automotive headlights stand out more at night than during the day).