Skip to content

Tune Qdrant 1M recall and latency profile #15

Description

@CaspianG

Goal: improve the service-backed 1M memory profile so the benchmark is useful for production readers.

Current checked-in baseline:

  • Qdrant service, 1M memories
  • recall@10: 0.506
  • average query latency: 45.81 ms

Target:

  • recall@10 >= 0.95 on the same generated benchmark profile
  • p95/p99 latency reported, not only average latency
  • reproducible command documented in docs/BENCHMARK_REPORT.md
  • results committed as JSON under benchmarks/

Likely work:

  • tune Qdrant collection/index parameters;
  • compare vector normalization and scoring assumptions;
  • tune candidate windows and reranking;
  • add a clearer large-scale benchmark profile for CI/manual runs.

Metadata

Metadata

Assignees

No one assigned

    Labels

    benchmarkReproducible benchmark, dataset, or metric work.help wantedMaintainers would welcome external help.indexingCandidate indexes, ANN, FAISS, pgvector, Qdrant.productionProduction hardening, reliability, or operations.qdrantQdrant backend or benchmark work.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions