The problem is the hardware is undocumented and the shipped drivers are proprietary so you would need to reverse engineer support for everything from the chipset to the modem to the display adapter.
So you can go throw a Debian Arm image in place of a system partition on many Android phones... it just won't boot.