I've met a few people who can rightfully lay claim, but yeah, an incredibly rare set of skills.
That said, there is a recent revival in building systems from the ground up. While you can't manufacturer your own transistors, it is quite possible to understand everything from simple logic gates to ALUs to older style CPUs and memory buses.