Skip to content

Add metadata to eval smoke JSONL records#598

Merged
RNA4219 merged 2 commits intomainfrom
codex/add-tests-for-metadata-inclusion-in-inputs
Nov 2, 2025
Merged

Add metadata to eval smoke JSONL records#598
RNA4219 merged 2 commits intomainfrom
codex/add-tests-for-metadata-inclusion-in-inputs

Conversation

@RNA4219
Copy link
Copy Markdown
Owner

@RNA4219 RNA4219 commented Nov 2, 2025

Summary

  • ensure the smoke test fixtures expect metadata in generated JSONL payloads
  • update eval_smoke.sh to populate metadata with the smoke task type, honoring overrides via EVAL_SMOKE_TASK_TYPE

Testing

  • pytest tests/scripts/quality/test_eval_smoke.py

https://chatgpt.com/codex/tasks/task_e_6907403236a883219bcfe102b427060e

@chatgpt-codex-connector
Copy link
Copy Markdown

You have reached your Codex rate limits. Please try again later.

@RNA4219 RNA4219 merged commit 3eeacff into main Nov 2, 2025
8 checks passed
@RNA4219 RNA4219 deleted the codex/add-tests-for-metadata-inclusion-in-inputs branch November 2, 2025 22:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant