Skip to content

Ensure eval smoke artifacts include metadata#600

Merged
RNA4219 merged 1 commit intomainfrom
codex/add-tests-for-metadata-in-smoke-eval
Nov 2, 2025
Merged

Ensure eval smoke artifacts include metadata#600
RNA4219 merged 1 commit intomainfrom
codex/add-tests-for-metadata-in-smoke-eval

Conversation

@RNA4219
Copy link
Copy Markdown
Owner

@RNA4219 RNA4219 commented Nov 2, 2025

Summary

  • extend the eval smoke test to assert metadata is present in normalized inputs, expected payloads, and the log
  • update the eval_smoke.sh helper to include metadata when writing normalized records and allow overriding it via EVAL_SMOKE_METADATA_JSON

Testing

  • pytest tests/scripts/quality/test_eval_smoke.py

https://chatgpt.com/codex/tasks/task_e_6907d6010c2c8321ab83df162ffdc5e3

@RNA4219 RNA4219 merged commit f08256b into main Nov 2, 2025
15 checks passed
@RNA4219 RNA4219 deleted the codex/add-tests-for-metadata-in-smoke-eval branch November 2, 2025 23:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant