Skip to content

Publish per-task article leaderboards#16

Merged
bingran-you merged 1 commit into
mainfrom
bry/article-suite-leaderboard-layout
Jul 13, 2026
Merged

Publish per-task article leaderboards#16
bingran-you merged 1 commit into
mainfrom
bry/article-suite-leaderboard-layout

Conversation

@bingran-you

Copy link
Copy Markdown
Collaborator

Summary

  • keep the top-level README focused on the final nine-task average leaderboard
  • replace the offline wide table with nine independently ranked task leaderboards followed by the final average leaderboard
  • add score-detail JSON links to every task leaderboard row
  • encode the same ordered 10-leaderboard structure in leaderboard/article_suite.json
  • refresh score-compatible task-digest provenance without changing any published scores

Validation

  • uv run pytest -q — 91 passed, 18 skipped
  • uv run ruff check .
  • uv build
  • uv run python scripts/validate_tasks.py — all nine tasks valid
  • leaderboard regeneration is deterministic
  • published per-task and average scores are unchanged

@vercel

vercel Bot commented Jul 13, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

1 Skipped Deployment
Project Deployment Actions Updated (UTC)
genesis-bench Ignored Ignored Jul 13, 2026 5:46pm

Request Review

@bingran-you bingran-you merged commit 0158693 into main Jul 13, 2026
3 checks passed
@bingran-you bingran-you deleted the bry/article-suite-leaderboard-layout branch July 13, 2026 17:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant