undefined | Better HN

0 pointsilliarian3y ago0 comments

So... nothing changes. It will be the tool for which you will need to manually construct prompts and clean up output (including imagined non-existent APIs).

The availability of a button inside an IDE doesn't make this a fundamental change in how we work

0 comments

10 comments · 5 top-level

crop_rotation3y ago· 5 in thread

It is so far ahead of even what the best IDEs do. For one, I have not seen GPT4 ever use non existent APIs. You don't need to carefully construct prompts. It tolerates typos to a good extent. You can just type a rough description and the output won't need cleaning manually. You might need to reiterate it to focus on some thing (like remove all heap allocations and focus on performance).

495313y ago

I've seen it use non existent APIs a lot. Working on a project that uses a dialect of python it told me it knew (Starlark) was like pulling teeth. It would tell me to use a python feature Starlark didn't have, I'd ask it to rewrite it without using that specific feature and it would with another feature Starlark didn't have access to, so I'd ask it to write the solution using neither and it would just give me the first solution again.

illiarianOP3y ago

> For one, I have not seen GPT4 ever use non existent APIs.

Have you asked it to use any API that appeared after September 2021 (that's the cut off date for its data)?

Have you asked it to write code in less popular languages (e.g. Elixir)?

Have you asked it to write code for less popular or unavailable APIs (smart TV integrations)?

leishman3y ago

Yeah it was basically useless for an Elixir project I was working on. That will probably change at some point I’m sure.

crop_rotation3y ago

I have used it to write Nim and Zig code (both not too popular languages).

I also asked it to write using non existent but plausible sounding APIs, and it flat out says "As of my knowledge cutoff in September 2021, I have no knowledge ...."

Ae you talking about GPT4 or the default ChatGPT?

1 more reply

raincole3y ago

How do you know GPT4's cut off date...? I mean it says that, but it can totally be it "learned" its (supposed) cut off date from the GPT3.5 output all over the internet, right?

2 more replies

cortesoft3y ago

I don’t know, I feel like it really does change how we can interact with a computer.

It feels like we are headed to a world where we can interact with a computer much more like they do in Star Trek; you ask the computer to do something using plain English, and then keep giving it refinements until you get what you want. Along the way, it is going to keep getting better and better and doing the common things asked, and will only need refinements for doing new things. Humans will get better at giving those refinements as the AI gets better at responding to them.

It is already incredibly good for being such a new technology, and will continue to rapidly improve.

visarga3y ago

The step up in accuracy from one shot solutions to iterative ones is large.

deeviant3y ago

If the button can do, let's say, half or more of the work for you when you press it, you're lying to yourself if you think it won't change anything.

dbtc3y ago

Nothing changes the same way that there is no difference between writing software in assembly and writing it in python.

j / k navigate · click thread line to collapse