They intentionally charge you the $5 because they are assholes who like to commit fraud. Dispute it with the credit card company. Don't even bother with Uber. Go straight to your credit card website and put a dispute on it as soon as it comes out of pending. I have not seen the fee with Lyft myself, but Uber's charging of fees is absolutely ridiculous. They claim to charge a fee after you've been waiting for a few minutes if you cancel, despite the fact that the only reason you've been waiting long enough to trigger the fee is because they are a bunch of fuckwads who can't provide decent service within a reasonable amount of time. The fee is fraud and you should treat it as such. As far as I can tell, the credit card companies do not even contact Uber anymore, they immediately refund you the money because they know it's fraud. Oh, and write your representatives, if you think that will make a difference--it won't.