I do it all the time actually. For example, someone will be calling me telling me something/someone I need to follow up with. I can start immediately emailing the person and at least get started, if not finish the task. Different strokes for different folks.
Edit: I also use Google Maps while talking, or check for movie times while someone is on the phone.