Hey, so I got pretty far into implementing open api specs for LLMs. To the point where you can point to an open api spec, ingest it, and then it’s available for GPT to select to satisfy user requests.
I do this by minify the specs and building an index to feed it that it selects from using logit bias.
Im at pause point on it while I figure out how to actually have GPT build the calls, but I think something like you have might solve that.
https://github.com/ShelbyJenkins/LLM-OpenAPI-minifier
