I agree it's a human rights issue, but it's a very complicated one, and trans rights conflict with other human rights. Sometimes biology matters.
Allowing biological females to participate in separate sports without biological males, for example. Where do you stand on that? Don't you agree that biology (like testosterone level) matters sometimes?
Or in dating, do you think people have the right to want to know the biological sex of someone they date?
I acknowledge the lived experience of trans people but I don't think their desires outweigh the interests of all other people.
And of course, balancing those competing interests is absolutely political. It's just dishonest to claim this isn't political.