Really cool to see people already testing the capabilities of OpenAI's latest release. Not sure how useful this will be in practice since it will likely lack business context/tribal knowledge, but still really interesting.
Yes, based on what I've experimented with OpenAI's assistants, it still requires engineering and developing tools to get the best performance on large databases.
How does this compare with LlamaIndex + Langchain SQL agents? It seems these tools still are not ready for production use cases, especially since the data gets sent to OpenAI.