Probably because it's one of those industries where legalizing it still attracts a large enough black market (human trafficking is a huge thing) that it's easier to just blanket ban it than try to separate the legal from the illegal