I also don't feel like electric cars are more loud, at least at moderate speeds. I always had the impression that they're a lot more silent inside cities. Maybe on a highway that would be different, I can't say.
The biggest offenders of background noise are obviously trucks though.