Docs: fill in README and add task.md spec#1
Open
xdotli wants to merge 5 commits into
Open
Conversation
Replace the stub README with a clear project overview — what PostTrain Arena is, how it works, the eight domains, how to contribute, validate, and submit. Add SPEC.md mirroring the full task.md authoring reference from posttrain.com/docs/spec.
![devin-ai-integration[bot]](https://avatars.githubusercontent.com/in/811515?s=60&v=4){kind=small}
Update to the current native task.md format: schema_version 1.3 (was version 1.0), /app workspace (was /root), verifier strategy model (script / llm-judge / agent-judge / reward-kit), reward at /logs/verifier/reward.txt, and the bench tasks init/normalize/check CLI with the full level set. Drop the stale verifier.md 0.3 schema and the cp-template scaffold.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Fills in the public repo so the GitHub link from the site lands on real docs instead of a stub.
benchCLI, and submit.task.mdauthoring reference, mirrored from posttrain.com/docs/spec (frontmatter schema, body sections, environment/verifier/oracle contracts, local validation).All links point to posttrain.com and this repo; no external hub references.
Note
Low Risk
Documentation-only changes with no runtime, auth, or application code touched.
Overview
Replaces the repo’s one-line README stub with a full PostTrain Arena landing page: what the competition is, contribute → post-train → IndexBench → rank, the eight
categorydomains, the four-piece task layout undertasks/, local validation viabench tasks check, PR submission expectations, and links to the site, catalog, and Discord.Adds
SPEC.mdas the in-repotask.mdauthoring reference: directory layout, frontmatter schema 1.3, body sections,environment/(including multi-container compose),verifier/strategies and reward artifacts,oracle/, andbenchCLI levels from schema through publication-grade/acceptance.Reviewed by Cursor Bugbot for commit e25223e. Bugbot is set up for automated code reviews on this repo. Configure here.