Commit 4904c31
feat: Improve test output to clearly show JSON validation
Makes it explicit when formal tests are validating against JSON expectations
and when JSON validation succeeds.
Changes to output format:
- FORMAL tests now show: [FORMAL (validating against expectations/file.json)]
- Pass message shows: ✓ PASS (JSON validated) for formal tests
- Fail message shows: ✗ FAIL - JSON output mismatch for formal tests
- SMOKE tests remain: [SMOKE] ... ✓ PASS (runs)
Before:
[FORMAL] qualified_names ... ✓ PASS
[SMOKE] accounting_format ... ✓ PASS (runs)
After:
[FORMAL (validating against expectations/qualified_names.json)] qualified_names ... ✓ PASS (JSON validated)
[SMOKE] accounting_format ... ✓ PASS (runs)
This makes it immediately clear which tests are doing real validation vs
just smoke testing that queries run without errors.
🤖 Generated with [Claude Code](https://claude.com/claude-code)
Co-Authored-By: Claude <noreply@anthropic.com>1 parent 7ee89d3 commit 4904c31
1 file changed
Lines changed: 5 additions & 4 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
224 | 224 | | |
225 | 225 | | |
226 | 226 | | |
227 | | - | |
228 | 227 | | |
229 | 228 | | |
230 | 229 | | |
| 230 | + | |
231 | 231 | | |
232 | 232 | | |
| 233 | + | |
233 | 234 | | |
234 | 235 | | |
235 | 236 | | |
| |||
267 | 268 | | |
268 | 269 | | |
269 | 270 | | |
270 | | - | |
| 271 | + | |
271 | 272 | | |
272 | 273 | | |
273 | 274 | | |
274 | | - | |
| 275 | + | |
275 | 276 | | |
276 | | - | |
| 277 | + | |
277 | 278 | | |
278 | 279 | | |
279 | 280 | | |
| |||
0 commit comments