Look at my arguments. I'm saying exactly what you're saying. Areas that need precise measurements (especially the sciences) are already using metric. I also prefer metric when cooking.
However, think of it this way: In conversational transfer of information, it makes zero difference. If I'm telling you something is 300 miles away, it isn't more useful for me to tell you it's 480 kilometers away. What extra information do you get from that? That it's 480,000 meters away? Humans can't properly visualize probably more than 100 meters. So what practical use when calculating driving distance is knowing that Kilometers vs meters the distance is?