> who in their right mind would trust the OCR'ed output?

> Is it stealing your (sensitive and expiring!) cookies

> running instructions from the AI on your local machine

Based on my interaction with LLM enthusiasts, there are plenty of people would happily bet their career, give up all their credentials, and grant full access to all their devices to LLM if they are promised something cool. See the stories about lawyers giving LLM-generated materials to the judge for an example, or journalists submitting LLM-generated articles.

Yes, this occasionally ruins someone's day. No, this would not stop true enthusiast from trusting the model again.

It could be using accessibility APIs instead of OCR. That seems like the sensible thing to me.

I'm not sure where the founder is from, but seems like he has Asian connections. And over there these type of super app (WeChat) that can do everything for you is quite very common. It would also make sense to centralise everything if it wasn't because this 800 lb of surveillance capitalism gorilla elephant in our metaphorical internet room.

> How can it access the Discord account for the "teach mode"? Is it stealing your (sensitive and expiring!) cookies to reproduce the actions on their cloud? Or worse yet, running instructions from the AI on your local machine?

That's what I caught too. It mentioned somewhere on their site that you'll have to provide login credentials through their Rabbit Hole dashboard panel of all services you want to use.

It breaks the services' ToS but I guess most people don't care much about giving their passwords. There's no other practical way to integrate with multiple services.

Given the collab with Teenage Engineering, and the price, I think this is pretty much in line with the kind of stuff they do.

Will it change the world? Unlikely. But there is definitely a niche that will love this, even if it's just for the form factor and design rather than anything practical. I'd also expect it to fit into TE's range of musical equipment in some form.

> It shows structured results from Spotify and Uber on the r1's screen. Does it have custom integration with all those apps?

Yeah there is a screenshot of a list of logins floating around, uber and spotify were on it.

Wouldn't be too interested in having it logging in to my account on a cloud machine on other things.

Most of these questions become irrelevant when you recognise that most of these kind of companies were most likely created to be purchased by Apple or Google.

It seems much of the screen content in this keynote was pre-rendered (or in other words fake), so many of the answers might very well be "it can't actually do these things".

> Why in the VC hell are they basing their revenue on a one-time sale of a clearly unnecessary electronic gadget (my phone already has all that!), when their biggest variable costs will be recurring cloud expenses?

It looks like they'll also be allowing people who create their own automations to sell them in their marketplace. Presumably they'll take a cut of the sales here.