undefined | Better HN

0 pointsJensson1y ago0 comments

> Running these models as agents is hella expensive

Because they are dumb so you need to over compute so many things to get anything useful. Smarter models would solve this problem. Making the current model cheaper is like trying to solve Go by scaling up Deep Blue, it doesn't work to just hardcode dumb pieces together, the model needs to get smarter.

0 comments

cchance1y ago

You mean like our dumb ass brains? Theirs a reason "saying the first thing out of your mind" is a bad fucking idea, thats what AI's currently do, they don't take a moment think about the answer and then formulate a response, they spit out their first "thought" thats why multi-shot works so much better, just like our own dumb brains.

JenssonOP1y ago

My brain can navigate a computer interface without using word tokens, since I have tokens for navigating OS and browsers and tabs etc. That way I don't have to read a million tokens of text to figure out where buttons are or how to navigate to places, since my brain is smart enough to not use words for it.

ChatGPT doesn't have that sort of thing currently, and until it does it will always be really bad at that sort of thing.

You are using a hand to hammer a nail, that will never go well, the solution isn't to use more hands the solution is to wield a hammer.

KoolKat231y ago

Your brain is doing this without you realising, just because you aren't verbalising it doesn't mean it's not iterating through its own output and selecting the best answer. Some of our thinking is purely illusion. Models can also do this, some models like Gemini allow you to see this in action where you get to select the best answer, there's also behind the scene methods such as q-learning.

When your muscle memory is instinctively clicking that start button, it's more akin to a very strong weighting after many sessions of reinforcement learning. Our brains may still be dumb but we can quickly say things like 1+1=...2 because we used reinforcement learning to strengthen the weighting back in primary school. We're not sitting visualising an abacus moving in our minds.

cchance1y ago

WTF are you even talking about, we're talking about understanding and communication not taking actions, navigating an OS and browser, tabs etc are actions, not thoughts or communication. This model isn't taking actions there is no nail to hammer lol, and if their was you'd be smashing a brain into a nail for some reason.

1 more reply

ianbicking1y ago

It's good in any prompt to give the AI a chance to think without impact (without executing anything, maybe without making anything specifically appropriate for the user to read). That works somewhat similarly to "taking a moment to think."

At that point they'll still have a tendency to use a stereotyped response and stick with it, instead of a thoughtful response, but you can try to address that in prompting too by asking for multiple proposals before choosing one.

hackerlight1y ago

Disagree. Even going by your example, AlphaGo uses many iterations of a "dumb" model in order to achieve incredible performance. If it had to single shot the solution with a model 100x bigger, it would perform worse. All that matters is the frontier of intelligence vs cost, and larger foundation models aren't necessarily going to push that frontier forward. AlphaCode hints at that.

j / k navigate · click thread line to collapse

0 comments

cchance1y ago

JenssonOP1y ago

ChatGPT doesn't have that sort of thing currently, and until it does it will always be really bad at that sort of thing.

You are using a hand to hammer a nail, that will never go well, the solution isn't to use more hands the solution is to wield a hammer.

KoolKat231y ago

cchance1y ago

1 more reply

ianbicking1y ago

hackerlight1y ago

j / k navigate · click thread line to collapse