Lady and Ladies is another set of words that could be used.
It's interesting that "Woman" is seen as stuffy and formal, whereas "man" is often used like "be a man" or "man up".
You usually have to put an adjective on "man" to give it a negative connotation, in my experience.
