Fwiw, you can set (on Android at least) the language of Google Maps independently of the rest of the system. I also have my phone set to English, but maps set to Dutch because otherwise the reading out of street names can be incomprehensible compared to their proper pronunciation.

This does mean your navigation instructions are also in that language, which may or may not be a problem, depending on your fluency (but there's not really a whole lot of phrases to learn.)