Description
The \ReportConfig.max_examples\ setting in the config YAML is supposed to control how many example results appear in reports. However, each report generator (Terminal, Markdown, HTML, JSON) hardcodes its own limit instead of reading this configuration value.
Current Behavior
\\python
In terminal.py
for i, result in enumerate(results[:10]): # hardcoded 10
\\
\\python
In markdown.py
for i, result in enumerate(results[:10]): # hardcoded 10
\\
Expected Behavior
Each generator should read \ReportConfig.max_examples\ instead of hardcoding the limit.
Files to Look At
- \openagent_eval/reports/terminal.py\
- \openagent_eval/reports/markdown.py\
- \openagent_eval/reports/html.py\
- \openagent_eval/reports/json_report.py\
Good First Issue ✅
A clear, multi-file fix that teaches how the report system works.
Description
The \ReportConfig.max_examples\ setting in the config YAML is supposed to control how many example results appear in reports. However, each report generator (Terminal, Markdown, HTML, JSON) hardcodes its own limit instead of reading this configuration value.
Current Behavior
\\python
In terminal.py
for i, result in enumerate(results[:10]): # hardcoded 10
\\
\\python
In markdown.py
for i, result in enumerate(results[:10]): # hardcoded 10
\\
Expected Behavior
Each generator should read \ReportConfig.max_examples\ instead of hardcoding the limit.
Files to Look At
Good First Issue ✅
A clear, multi-file fix that teaches how the report system works.