As a German with an expat partner, I'd say this depends very much. If you're working for consumer facing startups - sure. There's tons of those in Berlin and plenty in the other big cities (Germany is quite decentral). But if you want to settle a bit on the outskirts of even the big cities, it is a lot easier to understand at least some. I'd say 50% of the people we randomly interact with can hold a conversation in English.
And then there's work: There's a lot of good paying and rewarding tech jobs here that would seem foreign to SV types, in very specific domains or more traditional B2B. Getting a job at those places without speaking German is surely possible for a programmer, just a minor handicap maybe. But for other professions, it can be downright impossible.