Interestingly there's already an AI powered earbud [0] on the market that claims to do that; whether it's any good or if OpenAI can do better remains to be seen.
But how long before it's capturing audio from your conversations to use as training data?
[0] https://www.timekettle.co/
