LLMObservability Testing

Repro scripts for submitting evaluations against OpenTelemetry LLM spans in Datadog LLM Observability.

Scripts

• otel_eval_repro.py — Sends an OTel LLM span and submits evals using a decimal span_id.
• otel_eval_repro_hex.py — Same, but uses a hex span_id in the eval payload. Evals do not appear on the span.

Setup

pip install opentelemetry-api opentelemetry-sdk opentelemetry-exporter-otlp-proto-http requests openai python-dotenv
cp .env.example .env  # fill in DD_API_KEY and OPENAI_API_KEY

Usage

python otel_eval_repro.py
python otel_eval_repro_hex.py