For me this argument will hold water when we can put LLMs in jail if they commit a criminal act. Until then, an LLM is not a human and not entitled to be treated like one.

Moreover, at least in the case of music, people have been successfully sued when their song strongly resembles another copyrighted work. Thus "holding the human brain guilty for memorizing copyrighted work" is actually the status quo.