I have lots of contact with Germany, go there frequently and speak passable German but when I have people with me that don't this is never a problem and not because I'm translating.
The Germans that don't speak English are usually either quite old or are from rural areas. City and < 60: you can basically assume they speak English, and if you try German first they'll switch to English if you can't find your words unprompted.
This goes for most of Europe by the way.