No comment on whether it's broadly a good thing or bad thing, but you can't get ChatGPT (on GPT-4 at least) to tell you even slightly scandalous jokes without a lot of custom prompting and subterfuge, and they seem to be spending active development and model training time to try to counter a lot of the circumvention we've seen to get around these guardrails. Not just for dirty jokes but for anything deemed bad.
So it seems pretty clear you can load values into an LLM.