Description
Currently, the corpus auditing configuration (\CorpusConfig) exists as a separate model and is not integrated into the main \Config\ model. This means users can't configure corpus checks through a single \config.yaml\ file — they have to use CLI flags.
What to Do
- Integrate \CorpusConfig\ into the main \Config\ Pydantic model
- Update the config loader to parse the \corpus:\ section
- Update the CLI \�udit\ command to accept config from the file
- Add tests for the new integration
Files to Look At
- \openagent_eval/config/models.py\ — main config models
- \openagent_eval/corpus/base.py\ or \openagent_eval/corpus/models.py\ — existing CorpusConfig
- \openagent_eval/cli/commands/audit.py\ — CLI command
Good First Issue ✅
A more involved task that connects multiple parts of the system.
Description
Currently, the corpus auditing configuration (\CorpusConfig) exists as a separate model and is not integrated into the main \Config\ model. This means users can't configure corpus checks through a single \config.yaml\ file — they have to use CLI flags.
What to Do
Files to Look At
Good First Issue ✅
A more involved task that connects multiple parts of the system.