Right, people are talking about cabbies not wanting to go across the river in this thread for precisely that reason.
You should think of black cabs as vehicles for the wealthy to potter around Central London avoiding public transport, or for tourists to get mugged.
The average Londoner doesn't really use them.