It's worse than a headache.
With debit cards, you don't get a refund.
With cc's, typically you will have to state that you did not know about the fraudulent charges and that you did not loan out your card.
Usually you get an immediate credit with 60 days for the bank to finalize it.
However, if the number was entered into a database, the merchant can keep billing forever. Sometimes changing the cc number works, but sometimes the bank "forwards" the new charges to your replacement card.