Is your feature request related to a problem? Please describe.
VectorWave currently uses a custom tracing format stored in Weaviate. This makes it difficult to integrate with standard observability tools like Prometheus, Grafana, or Datadog in enterprise environments. Furthermore, users are only notified of explicit errors, missing subtle performance degradations.
Describe the solution you'd like
- OpenTelemetry (OTel) Export:
- Implement an exporter in
TraceCollector to send trace data in the standard OTel format.
- Allow integration with existing monitoring stacks.
- Anomaly Detection:
- Monitor execution logs for anomalies even if no error is raised.
- Detect unusual spikes in
duration_ms or significant deviations in return value vector distances compared to the historical distribution.
Additional context
This feature is crucial for adopting VectorWave in production environments where standard observability practices are already in place.
Is your feature request related to a problem? Please describe.
VectorWave currently uses a custom tracing format stored in Weaviate. This makes it difficult to integrate with standard observability tools like Prometheus, Grafana, or Datadog in enterprise environments. Furthermore, users are only notified of explicit errors, missing subtle performance degradations.
Describe the solution you'd like
TraceCollectorto send trace data in the standard OTel format.duration_msor significant deviations in return value vector distances compared to the historical distribution.Additional context
This feature is crucial for adopting VectorWave in production environments where standard observability practices are already in place.