With the wrong demanding coworker or (especially) midwit middle manager who wants to talk about sportsball or politics, your entire company loses, not sure what your (rather sexist) point is tbh.
Distractions happen. They come from lots of sources.
By focusing on the word "wife" and calling it sexism you miss the point of the comment entirely. I agree with your side of the conversation but nitpicking words and throwing in an attack doesn't help the conversation.
I absolutely did not miss the point of the comment entirely, and responded to it fully, pointing out that distractions are just likely to happen in the office as at home, given the wrong set of coworkers.