True, but this does no good if your email system doesn't accept it at all (the sender gets a bounce) or worse, if your email is silently deleted (not sent to the spam folder).
If I send you an email and gmail doesn't get it to you for either of the above reasons, you won't get a second chance.