Skip to content

[codex] Add Hegel property bench suite#1

Merged
fireharp merged 3 commits into
masterfrom
codex/hegel-verifier-mvp
Jun 8, 2026
Merged

[codex] Add Hegel property bench suite#1
fireharp merged 3 commits into
masterfrom
codex/hegel-verifier-mvp

Conversation

@fireharp

@fireharp fireharp commented Jun 8, 2026

Copy link
Copy Markdown
Owner

Summary

Adds an opt-in Hegel verifier layer for chant without changing recipe schema or the default verifier-first trust path. This now reports Hegel evidence per property instead of collapsing the suite into one aggregate result.

Changes

  • Adds chant bench --suite=properties as an explicit opt-in suite.
  • Keeps chant bench --suite=all as the fast compatibility gate: retrieval + e2e only.
  • Emits five property-level bench results with cases counts.
  • Writes the latest property report to .chant/hegel/properties-report.json.
  • Writes generated failure payloads to .chant/hegel/failures/<property-id>.json when a property fails.
  • Adds build-tagged Hegel property tests for retrieval invariants, runner trust gates, spell hash stability, and the CSV recipe oracle.
  • Pins hegel.dev/go/hegel v0.5.3 and keeps Hegel state under .chant/hegel/.
  • Documents hermetic CI usage with HEGEL_SERVER_COMMAND.

Property coverage

  • PROP-retrieval-stale-penalty: 50 cases
  • PROP-retrieval-signal-monotonicity: 50 cases
  • PROP-runner-trust-gate: 50 cases
  • PROP-spell-hash-stability: 50 cases
  • PROP-csv-recipe-oracle: 25 cases

Validation

  • go test ./...
  • go test -tags hegel ./internal/bench -run TestRunProperties_AllPass -count=1
  • go run ./cmd/chant bench --suite=properties --json -> total: 5, passed: 5, failed: 0
  • go run ./cmd/chant bench --suite=all --json -> retrieval + e2e only, failed: 0
  • git diff --check

Notes

Left unrelated untracked repomix-output.xml out of the commits.

@coderabbitai

coderabbitai Bot commented Jun 8, 2026

Copy link
Copy Markdown

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: b93e4f61-8700-4be1-b4c3-36eac84a9fb9

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch codex/hegel-verifier-mvp

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@fireharp
fireharp marked this pull request as ready for review June 8, 2026 18:17
@fireharp
fireharp merged commit 3d4515f into master Jun 8, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant