A party in OAuth authentication can request some obligatory information, and if email is part of it, you won't be able to deselect it.
In general, sites use email as an indication of a unique, real person. I imagine most of them do not really care about it afterwards, which is why the SSO systems even work (though, they can demand an email too).