I could be wrong considering it was over 2 decades ago and I never verified the floating point bug. There were no expansion ports on the computer and so I was using one of the built-in USB ports as that was the only expansion possible. This seems like the motherboard it would have used https://pb.retropc.se/770.html

But yeah windows 95 did have very limited USB support based upon the 2nd service pack if I remember correctly but it did not really work very well.

Yeah, USB + Ethernet [+ Firewire] all-in-one cards used to be reasonably common, because many motherboards in the PII-PIII time didn't have USB or only had two USB ports, and a lot also did not have an on-board Ethernet port.