Do you?
I'd simply never want to make somebody feel uncomfortable because I choose a time that is not appropriate for such interactions. And for me, that pretty much means that unless we are sharing personal time together outside of such a relationship, then I don't engage in such activities.
Social norms like this can and do change over time, and it's my opinion that this (specifically, that asking people out in a work environment is always or nearly always inappropriate) is one that should -- because I think there's an alternative set of norms that leaves essentially everyone better off. Specifically I think that if it was understood by everyone that a person asking another person out (in any context, including at work) is responsible for dealing with rejection like an adult and not continuing to pester the person, then (absent any power difference that might imply a quid pro quo situation), there would be no reason to forbid it. Most people would still hesitate to do it (asking someone out can result in rejection, rejection is embarrassing), but the kind of scenario described by Martinussen in https://news.ycombinator.com/threads?id=akoboldfrying#389248..., where an employee fears for their job if they don't pander to an entitled customer, won't occur.
Interested in your thoughts.