Publish Standard60 task snapshot#25
Conversation
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: 39fda0fa21
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
| run: | | ||
| IMAGE="$REPO:$(cat VERSION)" | ||
| docker pull "$IMAGE" | ||
| docker run --rm "$IMAGE" sh -lc ' |
There was a problem hiding this comment.
Fail verification when any service binary is missing
In the publish workflow, this inner sh script doesn't enable errexit; inside the loop, a failing command -v is overwritten by later iterations. If a pushed image is missing any binary except the last one (mock-stripe), the “Verify remote pull” step can still exit with the final successful check and pass while the published base image is incomplete. Add set -e or explicitly exit 1 on a missing command before the loop continues.
Useful? React with 👍 / 👎.
Summary
tasks/example_tasks/task.md+oracle/+verifier/layout across all 68 public task packages0.2.0so auth, Discord, and Stripe CLIs are includedWhy
The public repo exposed only 12 of the current 60 canonical tasks. The published
0.1.0/latestimage also predatedmock-auth,mock-discord, andmock-stripe, so those task packages could not build against the remote image.Public-data review
skillsbench.testidentities000-00-...fixturesexample.testprivate-repo links, and sensitive files
the explicitly non-secret deterministic mock-auth signing key
Validation
python3 -m unittest tests/test_standard60_tasks.py tests/test_public_data_hygiene.py0.2.00.2.0, smokes example images, and runs one oracle task for each ofthe eight public mock environments
Release impact
After merge, dispatch
Publish Base Image, verify all eightmock-*CLIs,publish GHCR
0.2.0andlatest, then tag and releasev0.2.