At the end of the day, what makes you happy might be a miserable time for others.
Personally, finding happiness in the action of others is fine for me, it is expecting reciprocation that makes some bitter and that is just unneeded burdens.
I haven't really found "real happiness" yet, but I still get a lot of happiness from talking to all my friends and knowing that I am loved and appreciated <3
Even when I lose or fail to make one, there are always others that I can hang out with to feel better.
What did they ultimately accomplish or gain by not sharing the details?
p.s. Is it interesting to anyone besides me how weak nanoGPT is compared even to 80s technology? I look forward to when training our own personal offline GPTs is widely prevalent with a few orders magnitude better accuracy / reasonality.
Also, this is interesting:
https://electronicbookreview.com/essay/constructing-the-othe...
> There is little evidence of The Policeman’s Beard’s process of production, likely due to its digital conception, as well as the normalcy of its creators. Chamberlain and Etter were two friends, with the former an amateur computer enthusiast and the latter employed as a computer programmer; neither felt it necessary to document production. Further, all of the referenced sources focus on Chamberlain, and Etter’s name has virtually disappeared from any record of activity since Racter. Even then, his name is mentioned only once, and between commas, in The Policeman Beard’s front matter. There does not appear to be any photographic evidence of Etter (while there is plenty of Chamberlain), nor evidence of additional contributions to any technological field. There is, frankly, no convincing evidence for Thomas Etter’s existence other than a few quotations attributed to him in news articles about Racter, and assurance from Chamberlain himself (correspondence with the author, who also confirmed that Etter is now deceased).
1) nearly every grammatically accurate combination of a human-chosen lexicon being constructed by a computer and then heavily human-filtered
2) a human writing a simple program, getting the feel of the basic computer process and then repeatedly emulating it for artistic/comedic effect
My money is on 2, as it is more fun and less work, especially when you consider it was the early 80s. Still at least the work of a human-computer hybrid in some sense.
From my own experience doing something very similar, I'm afraid that this won't cut it. Even a 1B parameter language model will struggle with the most simple topics. The smallest thing that I have seen, that may be useful for general purpose, is GPT-J with 6B parameters and even that is far from perfect. The idea of running these architectures in any useful way on old hardware is sadly a pipe dream. AI got where it is today mostly because of the increase in computing power.
The main problem is that 90% of the output is garbage: broken formatting, abruptly ending sentences, mixed languages, occasional nonsensical sentences like `your "two" type,ir zwe "G together"`. If I can produce something that looks like normal sentences even if they're not particularily meaningful, with ~90% reliability, that's all I need for my purposes, and I think the current bottleneck is actually the very poor dataset of my very heterogeneous notes.
I'm thinking about it like how some people love their pets or toddlers even though they struggle with the most basic tasks. The personal connection makes up for it :)
Are you thinking in doing it able to "chat"? (integrate your new input)
What gives? Most smartphones made in the last 10 years have more RAM than that.
> You're a real problem, but I'm just happy that you are doing.
Good line.
