The convergence of powerful LLM and VLM models with low-power wearable devices opens up entirely new frontiers for human-computer interaction, including memory augmentation, pro-active life assistance, and distributed knowledge gathering. We believe in exploring this transparently and openly, and look forward to contributions :)
Today, we launch with Apple Watch, Xiao ESP32S3 Sense, and Sony Spresense support. Code and design files for the ulta-low-power reference wearable coming soon. We are looking for select people to give out units to and set up private servers for, to help us test and spread the word!
The server is written in Python and the display client is a native iOS Swift app (but a web client is included in the project as well for those outside the Apple ecosystem).
my use case was to tape one pine bud to my shoulder to wear all day, and it would bluetooth connect to my android keyboard app, with the simple goals
#1) always record my voice even if I have another headset connected to the phone. I.e., do not get interrupted by incoming calls, spotify, or other bluetooth jank
#2) only do STT on my voice, bonus if you can figure out context and only do STT when i'm talking to the phone (via eyeballs?)
#3) always put the generated STT into a form, or if no form has focus, spawn a new browser tab and put focus on the search-input form
that's all. fin
