Skip to content

Deepen eval2otel contract and adapter coverage#41

Merged
haasonsaas merged 1 commit into
mainfrom
codex/eval2otel-next-wave
May 18, 2026
Merged

Deepen eval2otel contract and adapter coverage#41
haasonsaas merged 1 commit into
mainfrom
codex/eval2otel-next-wave

Conversation

@haasonsaas

Copy link
Copy Markdown
Contributor

Summary

  • Add adversarial conformance fixtures, semconv registry helpers, deeper RAG derived metrics, and Promptfoo conversion.
  • Add a provider adapter boundary with structured warning/evidence results plus a contract-first Python SDK scaffold.
  • Refresh dependency/security hygiene, E2E harness pins, package contents, and rewrite the README/docs around the current operator path.

Issue coverage

Test Plan

  • npm run lint
  • npm run build
  • npx tsc --noEmit
  • npm test -- --coverage
  • npm audit --omit=dev
  • (cd test-harness && npm ci && npm audit --omit=dev)
  • PYTHONPATH=python python3 -m unittest discover -s python/tests
  • npm pack --dry-run
  • CI=true OTEL_EXPORTER_OTLP_PROTOCOL=http/protobuf bash test-harness/run-tests.sh

@socket-security

Copy link
Copy Markdown

@github-actions

github-actions Bot commented May 18, 2026

Copy link
Copy Markdown

Code Coverage

Package Line Rate Branch Rate Complexity Health
src 96% 83% 0
src.integrations 96% 80% 0
Summary 96% (1018 / 1062) 83% (773 / 933) 0

@haasonsaas
haasonsaas requested a review from EvalOpsBot May 18, 2026 21:25
@haasonsaas
haasonsaas merged commit 7ef62a2 into main May 18, 2026
5 checks passed
@haasonsaas
haasonsaas deleted the codex/eval2otel-next-wave branch May 18, 2026 21:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

1 participant