Could you share anything (e.g. how many rows of data and tokens in each row) around how much it cost you to use GPT Index? It looks interesting, but it seems it'd be expensive.
Looks like it’s making extensive use of embeddings. The embeddings and vector comparisons are dirt cheap. The summarizing / answering functionality when the LLMs get involved is going to be the expensive part.
