undefined | Better HN

0 pointsint_19h4mo ago0 comments

It's still very much a problem.

For one hilarious example, Gemini (2.5; I haven't tried it with 3 yet) only knows about the old Google API for Gemini, not about the new one. So if you give it code written against the new stuff, it will often do things like, "this is definitely wrong, I know this API doesn't have this method, let me fix that".

0 comments

joegibbs4mo ago

I find Gemini 3 (and Claude 4.5) also only seem to know about the 2024 era of LLMs and will often just randomly rewrite calls to GPT5 to GPT4o, or Claude 4.5 to Claude 3.5 if it happens to find them in a file, regardless of whether I told it to do anything about that or not.

j / k navigate · click thread line to collapse

0 pointsint_19h4mo ago0 comments

It's still very much a problem.

0 comments

joegibbs4mo ago

j / k navigate · click thread line to collapse