tuckerconnelly

I'm used to bull-queue, which has excellent UIs for managing jobs (retry, delete, etc.) but python support is limited at the moment.

Flower is really bad IMO for managing jobs.

Is there an existing solution for managing celery tasks (paid or open source)?

Or if I really had to build one, if I built it, would your company pay for it?

Hi, I'm building an RAG system with OpenAI embeddings and the ChatGPT api.

I chunked all the documents into 400-800 character chunks, vectorized them all, and put them in a vector database.

The results are pretty bad--the surfaced document chunks kind-of-but-not-really match up with the query.

I'm getting much better results from simple keyword searches (using meilisearch).

Am I doing something wrong? Do I need to use a fine-tuned model like BERT? Is this technology vastly overhyped?