Skip to content

test: add frozen LSC-1 conformance corpus - #29

Merged
Th0rgal merged 6 commits into
mainfrom
post-g1-conformance-corpus
Jul 28, 2026
Merged

test: add frozen LSC-1 conformance corpus#29
Th0rgal merged 6 commits into
mainfrom
post-g1-conformance-corpus

Conversation

@Th0rgal

@Th0rgal Th0rgal commented Jul 28, 2026

Copy link
Copy Markdown
Member

Summary

  • add an immutable v1 corpus/schema with 18 stable, fingerprinted protocol cases and complete RETIRE records
  • cover SET/XOR/MUL, XOR A/B backsolve, all DEREF modes, taken/not-taken JUMP with a nontrivial inverse, deferred equality, malformed/error precedence, and representable lane lifecycle behavior
  • add the official reviewed Rust adapter compiled in a disposable worktree of leanVM-b c308034ab78619b39a59d26f3dc60e7df5b52649
  • keep infrastructure failures distinct from semantic mismatches and add deterministic replay/regeneration tests

Validation

  • python3 -m unittest discover -s sim -p 'test_conformance_corpus.py' -v — 5 passed
  • python3 tools/conformance_differential.py --validate-only — 18 fingerprints verified
  • python3 tools/conformance_differential.py --upstream ../leanVM-b — 10/10 upstream-representable cases passed with Rust 1.88.0
  • make check — passed (272 sim tests, 269 FPGA harness tests, recorded frozen comparison, checksum and repository checks)
  • make sim — passed (HDL, mutation, and 4 RTL differential tests)
  • make lean — passed (14 jobs + LeanVMBMinCore 13 jobs; existing linter warnings only)
  • make formal — passed (gf8_mul, ABC BMC3, 32 frames)

Note

Medium Risk
Touches protocol/oracle alignment and CI (Rust toolchain, frozen upstream); mostly new test artifacts and tooling, not production RTL paths.

Overview
Introduces an immutable v1 LSC-1 conformance lane: JSON schema, 18 fingerprinted cases in corpus-v1.json, a deterministic generator, and a reviewed Rust frozen_adapter that runs Program::execute against frozen leanVM-b c308034….

Cases capture wire bytes, endpoint state, staged transitions, full RETIRE metadata (or explicit non-retire), and either program_execute upstream expectations or protocol_only where upstream has no execute model (malformed frames, lane abort/reset/stall).

tools/conformance_differential.py validates schema and fingerprints (--validate-only) or diffs the 10 semantic cases via a disposable git worktree and locked Cargo (infra exit 2 vs semantic exit 1). make check gains conformance-check; CI systemverilog job adds conformance-differential. Unit tests assert generator reproducibility and lsc1_transaction replay. Docs, jsonschema dep, and .gitignore exception for checked-in conformance/*.json.

Reviewed by Cursor Bugbot for commit a1e0048. Bugbot is set up for automated code reviews on this repo. Configure here.

@cursor

cursor Bot commented Jul 28, 2026

Copy link
Copy Markdown

Bugbot couldn't run - usage limit reached

Bugbot is counted against Cursor usage for this user or team, and this run hit a usage or spend limit.

A user or team admin can review and increase usage limits in the Cursor dashboard.

(requestId: serverGenReqId_d185028d-b5b6-4356-9082-30b6bfcef176)

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: f6ebcc61ad

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread tools/generate_conformance_corpus.py Outdated
Comment thread tools/conformance_differential.py
@cursor

cursor Bot commented Jul 28, 2026

Copy link
Copy Markdown

Bugbot couldn't run - usage limit reached

Bugbot is counted against Cursor usage for this user or team, and this run hit a usage or spend limit.

A user or team admin can review and increase usage limits in the Cursor dashboard.

(requestId: serverGenReqId_02e22042-3260-408e-9fac-515460bdfde6)

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: bd506f4193

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread conformance/schema-v1.json
Comment thread tools/conformance_differential.py
@cursor

cursor Bot commented Jul 28, 2026

Copy link
Copy Markdown

Bugbot couldn't run - usage limit reached

Bugbot is counted against Cursor usage for this user or team, and this run hit a usage or spend limit.

A user or team admin can review and increase usage limits in the Cursor dashboard.

(requestId: serverGenReqId_19b14ff5-36b9-4f41-94bf-80b710cdbcbc)

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: bf929696a8

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread tools/conformance_differential.py
Comment thread conformance/schema-v1.json
Comment thread tools/generate_conformance_corpus.py Outdated
@cursor

cursor Bot commented Jul 28, 2026

Copy link
Copy Markdown

Bugbot couldn't run - usage limit reached

Bugbot is counted against Cursor usage for this user or team, and this run hit a usage or spend limit.

A user or team admin can review and increase usage limits in the Cursor dashboard.

(requestId: serverGenReqId_5ae127aa-17e1-42c8-a749-75efe1bec593)

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: ddce959ae7

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread Makefile
Comment thread conformance/schema-v1.json Outdated
@cursor

cursor Bot commented Jul 28, 2026

Copy link
Copy Markdown

Bugbot couldn't run - usage limit reached

Bugbot is counted against Cursor usage for this user or team, and this run hit a usage or spend limit.

A user or team admin can review and increase usage limits in the Cursor dashboard.

(requestId: serverGenReqId_6c850f25-9816-43b1-99a2-6b3091372d2d)

@Th0rgal
Th0rgal merged commit 428b409 into main Jul 28, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant