NVIDIA local AI builds are moving in that direction, but are wildly expensive. I think a lot of the current AI backlash (esp data-centers) comes from the public's accurate intuition that the current centralized, monopolistic, cloud-centric solution disempowers them, and eats any gains this magical technology would've brought them. Plugging a sliver box into the wall and your router, with no recurring fees; that would make people feel different about "taking our jobs" because they would be the unquestionable beneficiary.