undefined | Better HN

0 pointsIzkata1mo ago0 comments

My manager and I have been experimenting with it for some stuff, and our most recent attempt at using plan mode was a refactor to change a data structure and make some conversion code unnecessary, then delete it. The plan looked fine, but after it ran the data structure change was incomplete, most of the conversion code was still there, and it introduced several bugs by changing lines it shouldn't have touched at all. Also removed several "why" style comments and arbitrarily changed variable names to be less clear in code it otherwise didn't change.

This was the costliest one we had access to, chosen as an experiment - took $20 over almost a half hour to run.

0 comments

hombre_fatal1mo ago

Did you do the plan review cycles like I suggested? It's a critical point.

Plan mode gives you a plan file, then you refine that, and impl derives from it.

Also, do you know it cost $20 because you're using the Claude API? I'd definitely use a subscription for interactive/development use.

IzkataOP1mo ago

We reviewed the plan manually, asked it a few questions to clarify parts, and manually tweaked other parts.

I didn't catch what it was, some web dashboard that showed the cost per prompt. We could see it going up as it ran. We were just using the plan our company provided.

j / k navigate · click thread line to collapse