I think there is a material difference between buying a diamond and directly facilitating the activities of the drug cartels. In theory everyone buys things that are made by people in shitty conditions because there isn't much direct visibility on the front end as to what kind of nastiness happened elsewhere in the supply chain.
If you want that to change you have to make it illegal to do business with such folks not hope consumers fix it for you via the magic of the market.