It never confuses me though, despite being able to read German as well. The mind just shifts to whichever language you're reading and interprets any diacritics accordingly. English just doesn't seem to fall under the 'those are umlauts' category of languages for me.