Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions qet-bench/docs/blocker_ledger.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,9 +31,9 @@ Current release identity:
| Missing exact benchmark implementation and regression fixtures | Without exact values, the package cannot serve as a reproducible QET benchmark. | Closed | Core software | Implemented exact Hamiltonian, ground state, QET ledger, benchmark CSV, figures, and regression tests. | `v0.1.0` |
| No explicit no-free-energy accounting guardrail | QET is easy to overstate if Alice injection and global accounting are omitted. | Closed | Scientific framing | README, docs, tests, and paper state that Bob extraction is paid for by Alice measurement/control resources and check `E_A >= E_B` for the exact benchmark. | `v0.1.0` |
| Missing artifact provenance | Reviewers need to know which script generated each CSV/figure and what each artifact validates. | Closed | Reproducibility | Added artifact manifest mapping outputs to generators, validation coverage, and supported claims. | `v0.1.0` |
| Hosted CI unavailable because of quota | Hosted CI gives reviewers an independent, visible validation path; local-only validation is weaker. | Open | Review infrastructure | Hosted jobs currently fail before execution because account billing/spending limit blocks runners. Re-run GitHub Actions when quota permits and record the successful run URL or badge. Keep local Python 3.11/3.12 CI as the interim validation record. | blocked run <https://github.com/lucent-lab/qet-bench/actions/runs/24507161016> |
| Hosted CI unavailable because of quota | Hosted CI gives reviewers an independent, visible validation path; local-only validation is weaker. | Closed | Review infrastructure | Repository visibility was changed to public and GitHub Actions passed on Python 3.11 and 3.12. | hosted run <https://github.com/lucent-lab/qet-bench/actions/runs/24507308274> |
| Release archive DOI or Software Heritage ID missing | A GitHub tag is useful, but archival review generally needs a persistent citation target. | Open | Publication metadata | Archive the selected review snapshot, then update `CITATION.cff`, `paper.md`, `paper/README.md`, `research_roadmap.md`, and this ledger. | pending |
| Repository access for external review | Reviewers cannot inspect a private repository unless explicit access is granted. | Open | Review logistics | Make the repository public or grant reviewer access before submission. | pending |
| Repository access for external review | Reviewers cannot inspect a private repository unless explicit access is granted. | Closed | Review logistics | Repository visibility is public and the root README now points to package docs, validation records, and manuscript sources. | <https://github.com/lucent-lab/qet-bench> |
| Placeholder software citation metadata | Citation metadata must identify a real citable artifact and author record. | Mitigated | Publication metadata | Replaced placeholder contributor author with provisional author metadata and added preferred software citation fields. Add DOI once archived. | `v0.2.0-paper-review` |
| Manuscript venue ambiguity | Trying to satisfy JOSS, ReScience, and SoftwareX simultaneously weakens the paper. | Mitigated | Manuscript | Reframed `paper.md` as JOSS-style source and moved ReScience/SoftwareX notes to build/readiness documentation. | `v0.2.0-paper-review` |
| Manuscript lacks concrete quality-control evidence | Software venues need reproducible validation commands, versions, and artifact regeneration evidence. | Mitigated | Manuscript/review | Added quality-control table and local Python 3.11/3.12 validation record; hosted CI remains open. | `v0.2.0-paper-review` |
Expand Down
14 changes: 6 additions & 8 deletions qet-bench/docs/release_validation.md
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
# Release Validation Log

This log records local validation for review snapshots while hosted GitHub
Actions jobs are unavailable. Hosted CI remains the preferred independent
validation path once account billing/quota allows runners to start.
This log records hosted and local validation for review snapshots.

## v0.2.0 Review Target

Expand All @@ -11,10 +9,11 @@ Date: 2026-04-16
Hosted CI status:

- Workflow: `.github/workflows/ci.yml`
- Representative hosted run checked:
<https://github.com/lucent-lab/qet-bench/actions/runs/24507161016>
- Result: jobs did not start because the account billing/spending limit blocked
hosted runners.
- Passing run:
<https://github.com/lucent-lab/qet-bench/actions/runs/24507308274>
- Result: Python 3.11 and Python 3.12 jobs passed. GitHub emitted a
non-blocking Node.js 20 deprecation warning for `actions/checkout@v4` and
`actions/setup-python@v5`.

Local CI mirror:

Expand All @@ -34,4 +33,3 @@ Optional Qiskit/Aer bridge:

The optional bridge artifact lives under the ignored `results/` tree unless a
future release deliberately force-adds optional interoperability outputs.

8 changes: 4 additions & 4 deletions qet-bench/docs/research_roadmap.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,8 +6,8 @@ DOI becomes available.

For the step-by-step path from the QET benchmark into broader void/vacuum
energy-accounting work, see `vacuum_investigation_roadmap.md`. For review risks
and submission blockers, see `blocker_ledger.md`. For the current local
validation record while hosted CI is unavailable, see `release_validation.md`.
and submission blockers, see `blocker_ledger.md`. For the hosted and local
validation record, see `release_validation.md`.

Status values:

Expand All @@ -30,15 +30,15 @@ Current release identity:
| Stage | Status | Reproduction Or New Territory | Deliverable | Reference |
|---|---|---|---|---|
| Exact two-qubit QET benchmark package | Done | Reproduction | Minimal exact simulator, Hamiltonians, ledgers, null tests, count estimators, deterministic benchmark scripts, generated artifacts, artifact manifest. | `v0.1.0` |
| Repository hygiene and local CI path | Done | Reproduction hardening | `.gitignore`, GitHub Actions workflow, pinned requirements lock, local CI recipe for Python 3.11 and 3.12. Hosted CI remains billing/quota-blocked until re-run. | `v0.1.0` |
| Repository hygiene and local CI path | Done | Reproduction hardening | `.gitignore`, GitHub Actions workflow, pinned requirements lock, local CI recipe for Python 3.11 and 3.12, and hosted CI workflow. | `v0.1.0`; hosted run <https://github.com/lucent-lab/qet-bench/actions/runs/24507308274> |
| Controller accounting extension | Done | Accounting extension; not new microscopic physics | Conservative nonnegative controller-cost ledger and documentation. Reports diagnostic net battery gain without claiming a hardware battery model. | `v0.1.0` |
| Manuscript release provenance | Done | Publication hardening | Paper build notes, release-provenance wording, local verification record, and submission-risk notes. | `v0.2.0-manuscript` |
| Independent pure-Python reference branch | Done | Reproduction cross-check | Branch-amplitude implementation independent of the NumPy matrix propagation path, with benchmark and branch-audit artifacts. | `v0.2.0-manuscript` |
| Optional Qiskit/Aer interoperability bridge | Done | Reproduction/interoperability | Lazy optional Qiskit/Aer adapter, count-key canonicalizer, branch-resolved ideal-circuit script, docs, and tests that pass without Qiskit installed. | `v0.2.0-qiskit-bridge` |
| Fixed-protocol noise-survival atlas | Done | New simulation diagnostic; not a universal threshold result | Anchor-aware survival curves and summaries across a predeclared `(h, k)` set, interval-averaged survival ratios, and small-multiples figures. | `v0.2.0-noise-atlas` |
| JOSS-style manuscript hardening | Done | Publication hardening | JOSS-shaped `paper.md`, stricter venue notes, claim-to-artifact map, quality-control table, expanded citation metadata, and contribution guidelines. | `v0.2.0-paper-review` |
| Public archive and DOI | Processing | Publication hardening | Archive the chosen review snapshot with Zenodo, Software Heritage, or equivalent; update `CITATION.cff`, `paper.md`, and this register with DOI/SWHID. | pending |
| Hosted CI revalidation | Processing | Reproduction hardening | Re-run GitHub Actions once billing/quota permits; recent hosted jobs were blocked before execution, so `release_validation.md` records the local Python 3.11/3.12 validation substitute. | pending; blocked run <https://github.com/lucent-lab/qet-bench/actions/runs/24507161016> |
| Hosted CI revalidation | Done | Reproduction hardening | GitHub Actions passed on Python 3.11 and 3.12 after the repository was made public; `release_validation.md` records the hosted and local validation details. | hosted run <https://github.com/lucent-lab/qet-bench/actions/runs/24507308274> |
| Optional Aer smoke artifact with Qiskit installed | Processing | Reproduction/interoperability | Local Python 3.12.8 smoke passed with `qiskit==2.3.1` and `qiskit-aer==0.17.2`; document the generated comparison artifact and close after merge/tag. | pending |
| ReScience-style reproducibility package | Processing | Reproduction publication | `paper/rescience.md` frames the work as an exact reproduction of the two-qubit QET benchmark with validation artifacts and bounded novelty claims; close after merge/tag and final author metadata confirmation. | pending |
| Full microscopic controller/environment ledger | Not done | New methods territory | Replace conservative bookkeeping diagnostics with an explicit modeled controller, memory reset, pulse, and environment exchange ledger. | none |
Expand Down
9 changes: 4 additions & 5 deletions qet-bench/paper/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -48,7 +48,7 @@ The paper text is not yet a final submission. The hard blockers are:
|---|---|
| Author metadata | Confirm author list, affiliations, ORCID identifiers, and corresponding author. |
| Archival DOI | Archive the target release with Zenodo, Software Heritage, or equivalent and update the paper metadata. |
| Repository access | Ensure the GitHub repository is public or that reviewers have explicit access. |
| Repository access | Closed: the GitHub repository is public at <https://github.com/lucent-lab/qet-bench>. |
| Public history | JOSS currently screens for sustained public development history and research impact; submit to JOSS only after those signals exist. |
| Hosted CI | Re-run GitHub Actions when quota is available, or clearly document local CI as the validation record for a reproducibility venue. |
| Community guidelines | Keep `../CONTRIBUTING.md` current and make sure issue reporting and contribution workflow are visible from the repository root. |
Expand All @@ -67,10 +67,9 @@ python scripts/make_all_figures.py
```

These commands were run locally on Python 3.11 and Python 3.12. Hosted GitHub
Actions is configured, but hosted jobs were blocked before execution by the
account billing/spending limit at the time this note was written. A representative
blocked hosted run was
<https://github.com/lucent-lab/qet-bench/actions/runs/24507161016>.
Actions passed on Python 3.11 and Python 3.12 after the repository was made
public:
<https://github.com/lucent-lab/qet-bench/actions/runs/24507308274>.

## Venue Fit

Expand Down
6 changes: 3 additions & 3 deletions qet-bench/paper/paper.md
Original file line number Diff line number Diff line change
Expand Up @@ -142,9 +142,9 @@ python scripts/reproduce_benchmarks.py
python scripts/make_all_figures.py
```

Hosted GitHub Actions CI is configured, but hosted jobs were blocked before
execution by the account billing/spending limit at the time of this draft. Local
CI is therefore the current validation record.
Hosted GitHub Actions CI passed on Python 3.11 and Python 3.12 for the current
review target. Local CI and optional Qiskit/Aer smoke checks are recorded in
`docs/release_validation.md`.

# Limitations

Expand Down
Loading