Chrome does/did this already. They've never been of any forensic interest to me but the history file stores clusters of domains visited and keywords searched for. It was pitched as user "Journeys." I think they've deprecated it.

https://chromeunboxed.com/chrome-memories-history-journeys

A 4B model is not very useful for text generation, but useful for classification, so you're probably right.