Japan can't even sell arms to Taiwan right now. Even starting selling arms would be a huge change, let alone a mutual defensive pact.
It's extremely hard to change the constitution of Japan. It's the only constitution that has never been revised since WWII. LDP has been pushing this agenda for decades and nothing really happened.