Let's remove some of the inflammatory language and look at more as this person doesn't "matter" to me. If I think the taxi driver is just a taxi driver, I am going to treat them as I would any person I'm not likely to meet again. Ideally, with respect but when one's guard is down an asshole is more likely to act like one.
In the interview room, any candidate will be on their best behavior since impressing those people "matters" greatly. Same for the behavioral lunch sessions that many companies also use. If I have any sense, I'm going to recognize that this is still part of the "interview" even though we may be at a restaurant offsite discussing anything from the job to the Yankees pitchers.
The argument, that I tend to agree with, is that gathering info from the taxi driver is a better indicator of true character. I don't expect the taxi driver to deliver a full psychological report but I would like to know if they felt mistreated in some way.