Yes, you can do that --- but it won't fully eliminate the privacy issues. Contact with Google servers is hard coded into the Android source in various places. /e/OS strips this out and replaces it.
Also, most people won't forgo a lot of convenience apps/features that depend on Google services. MicroG allows most of these apps to still work without privacy invasion.