I worked in a Wall St. firm in the 90's and wore suit and tie every day, even though my job was neither customer facing nor even in New York.
I quickly realized I didn't mind it at all once I found correctly fitting shirts. If you consider a tie to be too constricting, you have the wrong shirt.
Even as borderline OCD (self diagnosed, so likely wrong), I never found particular clothes to be a hinderance to me typing (I'm a software dev), and I'm one of those guys that can't stand tags in t-shirts and rip them out. I think 90% of the angst over "comfortable" clothes is a learned cultural thing, and overblown. IMO.