>I'm pretty sure I could use that same logic to argue against organ transplants.

When the organ is question is the brain, that argument is correct.