Well, the only place where a non-programmer would treat the idea that programmers should have offices with incredulity would be a place that doesn't value software as its core business.

I mean, most "programmers" don't work for software companies; many of them are employed by banks and insurance companies. It's natural for that to be treated weird there.