Yeah, I do think your view is a bit skewed. There's an ever-growing number of users that grew up with computers, who know at least how to install a different program on their own, despite most definitely not being a techie either.
And even among techies, I think you overestimate how many actually care about much else than "fast" when it comes to a browser. Just look at how many techies run Chrome. It's usually not the most wizardly of techies, but a good number of techies either way.