I don't disagree with you, but it's also important that there is accountability. There is currently little accountability with LLMs.
One could argue that the user should be accountable, but that doesn't account for how an LLM is trained. A user should clearly not be held accountable for being harmed if using an LLM maliciously trained to harm users. Most legal systems punish negligence in a position of power, so it stands to reason that the creator of an LLM should bear some responsibility for its behaviour.
It is not yet clear to me how accountability should be portioned out to the user, operator, publisher, trainer, and model creator, but my feeling is that all bear at least some responsibility for its use.