It probably wouldn’t cost $199 with a capable chip and the battery to go with that.

Actually the only device with such features is a recent smartphone. Wouldn’t this be better as an app?

It's not a matter of "catching on". There are smaller models and they have been looking into putting useful models on device from day one.

It's just the fact that the models that can currently run on a mobile device are not effective enough. It is about the most memory and compute intensive type of application ever. In particular, models that can reason or follow instructions reliably and for general purpose are too big to run quickly on mobile devices.

They are putting models on phones, but they do not have general purpose assistant capabilities.

This may change in the next few years though.

> the industry is only starting to catch onto on-device models language models.

i mean there are technical limitations and tradeoffs to running LLM-size models locally. doesnt help to ascribe it to lack of foresight when it is a known Hard Problem.

Need to submit your OpenAI API key to use the full service. :P

Really, so this whole thing could be a $9.99 app on my existing phone :-). And if it is that good then I can delete all the other apps.

Ah already have ChatGPT installed, that'll do :-).