Readme validator#49

Merged

nashjain merged 71 commits into

mainfrom

codex/readme-validator

Jun 11, 2026

Commits on May 17, 2026

feat: add validate readme command to extract command and validate the terminal output from console with the one in readme file

Specmatic Lab
authored and
nashjain
committed
chore: add PASS/FAIL status at the end of the console output

Specmatic Lab
authored and
nashjain
committed
Improve README validator output and reset behavior

Specmatic Lab
authored and
nashjain
committed
feat: run all labs sequentially.

Specmatic Lab
authored and
nashjain
committed
Fixed README command

SaachiKaup
authored and
nashjain
committed
updated command in dictionary and added absolute path of /specs/dictionary.yaml in terminaloutput of command - relative path not present in console log

SaachiKaup
authored and
nashjain
committed
Updated README message in failure for continuous integration - previous message was incorrect

SaachiKaup
authored and
nashjain
committed
Running docker compose up in detached state, to avoid timeout error during validation

SaachiKaup
authored and
nashjain
committed
Running docker compose up in detached state, to avoid timeout error during validation

SaachiKaup
authored and
nashjain
committed
Moved alternative command to location after chmod command - post action, fenced windows command with

SaachiKaup
authored and
nashjain
committed
Updated Actual/Expected messages table to newer format - failed previously

SaachiKaup
authored and
nashjain
committed
remove transient info from terminal output
nashjain
committed
fix: quick-start-contract-testing readme's terminal output

Specmatic Lab
authored and
nashjain
committed
Removed WIP tag from expected output

SaachiKaup
authored and
nashjain
committed
Added WIP Tag

SaachiKaup
authored and
nashjain
committed
Updated WIP count

SaachiKaup
authored and
nashjain
committed
api-coverage: Updated WIP counts

SaachiKaup
authored and
nashjain
committed
api-security-schemes: Updated WIP counts

SaachiKaup
authored and
nashjain
committed
dictionary: Updated WIP counts

SaachiKaup
authored and
nashjain
committed
kafka-sqs-retry-dlq : Updated WIP counts

SaachiKaup
authored and
nashjain
committed
workflow-in-same-spec : Updated WIP counts

SaachiKaup
authored and
nashjain
committed
api-resiliency-testing: Added commands + WIP counts

SaachiKaup
authored and
nashjain
committed
schema-design : Added commands + added file for replacement data (payments-request.yaml) + WIP counts

SaachiKaup
authored and
nashjain
committed
response-templating : Added commands + added file for replacement data (test_find_available_products_book_200.json) + WIP counts

SaachiKaup
authored and
nashjain
committed
schema-design : payments-request.yaml (Drop in replacement file)

SaachiKaup
authored and
nashjain
committed
Added 3 tested labs

SaachiKaup
authored and
nashjain
committed
filters : added alternative run command

SaachiKaup
authored and
nashjain
committed
filters: Added WIP counts, passes

SaachiKaup
authored and
nashjain
committed
overlays : added alternative run command + file for overlay changes

SaachiKaup
authored and
nashjain
committed
Commented line in , restored to original

SaachiKaup
authored and
nashjain
committed
Added alternative run command in overlays

SaachiKaup
authored and
nashjain
committed
overlays: added WIP counts

SaachiKaup
authored and
nashjain
committed
backward compatibility: File copy based approach. Added alternative run commands

SaachiKaup
authored and
nashjain
committed
external examples, added alternate command

SaachiKaup
authored and
nashjain
committed
chore: remove unnecessary extra line break

Specmatic Lab
authored and
nashjain
committed
Add multi-lab mode and smarter cleanup

Specmatic Lab
authored and
nashjain
committed
chore: update validate_readme_commands.py so the positional argument is now a lab folder, not a README path.

Specmatic Lab
authored and
nashjain
committed
Improve README validator diagnostics and defaults

Specmatic Lab
authored and
nashjain
committed
WIP fix for schema-resiliency-testing lab

Specmatic Lab
authored and
nashjain
committed
add filters and overlays to default_labs list

Specmatic Lab
authored and
nashjain
committed
Backward compatibility readme fixed

SaachiKaup
authored and
nashjain
committed
Fixed labs: async-event-flow, external-examples, kafka-avro, partial-examples, quick-start-mock

SaachiKaup
authored and
nashjain
committed
Updated labs

SaachiKaup
authored and
nashjain
committed
Curl command Dockerized in quick-start-mock

SaachiKaup
authored and
nashjain
committed
Improve README validator preflight and reporting

Specmatic Lab
authored and
nashjain
committed
Polish validator warmup and summary output
nashjain
committed
Add CI workflow for parallel lab README validation
nashjain
committed
fix: normalize README docker path examples and preserve validator results on cleanup failure
nashjain
committed
fix: stabilize README validation and split async-event-flow studio startup from CI path
nashjain
committed
fix: harden README validator for CI and stabilize lab commands
nashjain
committed
fix: drop the subsequence search
nashjain
committed
fix: simplify backward compatibility lab commands by running container as host user to avoid Git dubious ownership on mounted repo
nashjain
committed
fix: add curl timeouts to data-adapters verifier to prevent README CI hangs
nashjain
committed
cleanup: remove the unused print_dry_run() wrapper, stopped reparsing README command blocks by introducing a single _readme_command_specs() helper and using it in preflight and Docker warmup detect…
nashjain
committed

Commits on May 21, 2026

cleanup
nashjain
committed

Commits on May 22, 2026

backward-compatibility-testing does not require additional openapi spec file copies we can just use sed to do the necessary changes instead of copies whole files
nashjain
committed

Commits on May 25, 2026

Commits on May 28, 2026

added debugging logs to bcc readme
nashjain
committed