This would indeed be a good idea. The problem is that other email providers will often reject your emails (e.g. because they consider your emails to be spam or simply don't trust your server), so this idea is not easy to get to work.

So the next best solution is to use an email provider that is somewhat established (avoiding the mentioned problem), but is more trustable than Google.