The only downside is that a few things are ridiculously difficult when (in my opinion) they shouldn't be, for example setting up printers.
I don't think the average 'man in the street' could install FreeBSD as a Windows replacement, but then they couldn't administer Windows properly either.