Skip to content

Update eval smoke to use normalized output text#596

Merged
RNA4219 merged 1 commit intomainfrom
codex/update-test_eval_smoke.py-assertions
Nov 2, 2025
Merged

Update eval smoke to use normalized output text#596
RNA4219 merged 1 commit intomainfrom
codex/update-test_eval_smoke.py-assertions

Conversation

@RNA4219
Copy link
Copy Markdown
Owner

@RNA4219 RNA4219 commented Nov 2, 2025

Summary

  • extend the smoke-test stubs to emit unique normalized text and capture the evaluator payloads
  • update assertions to ensure the normalized output flows through the generated jsonl files
  • teach eval_smoke.sh to populate inputs/expected bundles from the normalizer output without altering whitespace

Testing

  • pytest tests/scripts/quality/test_eval_smoke.py

https://chatgpt.com/codex/tasks/task_e_69073ac6a0988321b0e717280c42f4f1

@RNA4219 RNA4219 merged commit ea31d7a into main Nov 2, 2025
15 checks passed
@RNA4219 RNA4219 deleted the codex/update-test_eval_smoke.py-assertions branch November 2, 2025 11:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant