I tried to help a sex worker with ChatGPT and all it did was preach about avoiding sex work, further marginalizing in its virtue signalizing. I dont consider her marginalized, and “help” was just information about her job and techniques and venues. ChatGPT would have consumed this textual information too.

But yeah offline fine tuned models wont have this problem.

Kind of cool to see how the SWERF representation in tech is going to speedrun SWERF irrelevancy.

Microsoft Azure still has the GPT-3.5 foundation model, code-davinci-002. It is not fine-tuned for instruction following, safety, or censorship.

I'm not sure though whether Microsoft analyzes the input/output with another model to detect and prevent certain content.

You are missing the point. There are layers and the LLM is one layer (orchestration), but you can always have other semantic kernels with skills connected to other software (do stuff).