The other problem is a landfill or dump is miles and miles away. As you said, they charge money, and they also have rules.
You might not be able to throw out bags of household trash, for example. They also usually don't take certain kinds of waste like old tires, construction debris, appliances, paint, batteries, etc.
So people just dump it wherever they find empty lots.
