> Is it because compact flash cards are generally older and cheaper and (more likely) more of a size-match for the older hard-drives of the 1980s and 1990s?
Probably because CF uses the samw interface spec as older drives, original CF uses PATA, some later versions used SATA, both are probably simpler than USB (not sure what SD uses.)