This hit me as being incredibly scary since so far I've been treating chats like disposable browser tabs and my intuition was that GPT was limited by context anyway. It looks to me like there's a silent change behind the scenes that starts aggregating a profile of mine to inject into context.
From interviews, I know they're after building a helpful assistant that "knows everything about you", but this struck me as very surprising anyhow, and I'm still trying to understand why.
I think it's the combination of
- silently adding this feature without info or opt-in
- retroactively applying it to chats
- assuming all previous chats and questions are from the same person
- apparently assuming no sensitive stuff has been discussed so far
Not sure if others think this is okay and especially since I've opted out of training on my data, I'm even wondering whether this is legal under GDPR Art. 19 (I'm a EU "data subject").
Thoughts and experiences appreciated.
