All research I've seen finds that talking while driving, even if it's just to a passenger increases accidents by a large amount. Other studies show that people tend to vastly overestimate their multitasking abilities.
So in short: very few people can actually talk safely while driving, and the people that think they can probably can't.