Most vector database benchmarks today focus on toy use cases: static data, pure ANN search, no filters, no writes.
That’s not how things work in production.
We built VectorDBBench to benchmark vector databases under real-world conditions. It’s open source and just hit v1.0.0.
What’s new in v1.0.0:
Label Filtering + vector search tests
Concurrent read/write under pressure
Customer dataset
Better webUI
It supports several popular vector DBs out of the box (Milvus, Weaviate, Qdrant, Chroma, etc.) and is easy to extend.
If you’re building anything with RAG, embeddings, or search infra, we’d love feedback.
