Unfortunately some of the nastier vendors (gyms are notorious for doing this) will then send the charge to collections, resulting in a worse outcome. Further, credit card companies will likely reject your chargeback before it even gets to this stage since they require evidence that one tried a good faith attempt to cancel.