undefined | Better HN

0 pointscrackrook1y ago0 comments

This still doesn't get at the point, with this example you've effectively constructed a prompt along the lines of: "Note: A calculator is available upon request wink, here's how you'd use it: ... Now, what's the eighth root of 4819387574?"

Of course the model will use the calculator you've explicitly informed it of. The article is meant to be a critique of claims that LLMs are "intelligent," when, despite knowing their math limitations, don't generally answer "You'd be better off punching this into a calculator" when asked a problem

0 comments

2 comments · 1 top-level

IanCal1y ago· 1 in thread

How have I told it there's a calculator? All I've given it is the ability to search for tools and enable ones it wants.

> Of course the model will use the calculator you've explicitly informed it of

I didn't. I also gave it no system prompt pushing it to always use tools or anything.

It searches for tools with a query "calculator math root" and is given a list of things that includes a calculator. It picks the calculator, then it uses it.

The code and trace are right there.

crackrookOP1y ago

What do you imagine `tools` is doing if not a system prompt? I suggest reading the documentation: https://docs.anthropic.com/en/docs/build-with-claude/tool-us...

The vast majority of features that Anthropic and OpenAI ship are just clever ways of building system prompts

1 more reply

j / k navigate · click thread line to collapse