undefined | Better HN

0 pointssigmoid105mo ago0 comments

Depends on how strictly you define your types. Are you using pydantic to pass the information to the API? There are a few pitfalls with this, because not everything is fully supported and it gets turned into json behind the scenes. But in principle, the autoregressive engine will simply not allow tokens that break the supplied schema.

0 comments

striking5mo ago

Not sure if I've been using it wrong but I've tried using the Zod-to-structured-output helper with GPT-5 and often gotten weird stuff like trailing commas that break a parse or seeing multiple JSON responses in the same response.

Ultimately there are still going to be bugs. For this reason and several others you'll still need it wrapped in a retry.

sigmoid10OP5mo ago

Yeah that sounds 100% like a user or middleware issue. Don't bother with these wrappers, they are always outdated anyways. Learn how to use the API directly, it will save you a ton of headaches. And it's really not that hard.

striking5mo ago

No, we're using the OpenAI vendored version of zod-to-json-schema via https://github.com/transitive-bullshit/openai-zod-to-json-sc..., and applying it directly to the `json_schema` field of the OpenAI API. Maybe we have a subtle bug somewhere but I'd expect a 400 response if we were genuinely sending a malformed request.

j / k navigate · click thread line to collapse

0 pointssigmoid105mo ago0 comments

0 comments

striking5mo ago

Ultimately there are still going to be bugs. For this reason and several others you'll still need it wrapped in a retry.

sigmoid10OP5mo ago

striking5mo ago

j / k navigate · click thread line to collapse