Skip to content

results: add RH-SWE-bench image, move At a glance to top, RH-SWE-bench first - #315

Merged
OsherElhadad merged 3 commits into
mainfrom
results/rh-swe-bench-image-and-reorder
Aug 12, 2026
Merged

results: add RH-SWE-bench image, move At a glance to top, RH-SWE-bench first#315
OsherElhadad merged 3 commits into
mainfrom
results/rh-swe-bench-image-and-reorder

Conversation

@OsherElhadad

Copy link
Copy Markdown
Collaborator

Summary

This PR makes three changes to the Results page and README:

site/results.html

  • At a glance diagram moved to top — the summary SVG chart now appears before any benchmark section so readers immediately see the full picture
  • RH-SWE-bench is now the first benchmark section — placed before toy_calc and the τ²-bench runs
  • RH-SWE-bench run image addedrh_swe_bench.png is embedded in the RH-SWE-bench section below the results table
  • TOC updated to match new order: At a glance → RH-SWE-bench → toy_calc → τ²-bench → Qwen → SkillsBench
  • og:image / twitter:image meta tags updated to rh_swe_bench.png

site/assets/rh_swe_bench.png

  • New image file: Harbor SWE-bench Verified run overview (baseline 58.0% → optimized 76.5% across 119 tasks)

README.md

  • RH-SWE-bench row added first in the results table
  • rh_swe_bench.png image embedded after the table
  • ASCII At a glance diagram added showing baseline → optimized across all four benchmarks

t and others added 3 commits August 12, 2026 20:49
…h first

- Add site/assets/rh_swe_bench.png (Harbor SWE-bench Verified run overview)
- results.html: move 'At a glance' diagram section to top of page (before
  all benchmark sections) so readers see the summary first
- results.html: move RH-SWE-bench section to be the first full result,
  before toy_calc and tau2-bench sections
- results.html: embed rh_swe_bench.png in the RH-SWE-bench section
- results.html: update TOC order to match new section order
  (At a glance → RH-SWE-bench → toy_calc → tau2 → SkillsBench)
- results.html: update og:image / twitter:image meta to rh_swe_bench.png
- README.md: add RH-SWE-bench row to results table (first row)
- README.md: add rh_swe_bench.png image and ASCII 'At a glance' diagram
  to the Results section
Signed-off-by: Osher Elhadad <osher.elhadad@live.biu.ac.il>
When pytest collects from the repo root with the default prepend import
mode, both

  skills/algorithms/evograph/dashboard/backend/tests/test_app_security.py
  plugins/cap-evolve/skills/algorithms/evograph/dashboard/backend/tests/test_app_security.py

resolve to the same Python module name (test_app_security) because
neither tree has __init__.py files all the way up. pytest caches the
first import under sys.modules['test_app_security'] and reuses it for
the second, so the second file's fixtures (including 'client') are never
registered — causing six 'fixture not found' errors in the full suite
while the tests pass in isolation.

Add a root conftest.py that excludes the skills/ copy (the source
template) from collection, leaving only the plugins/ copy (the deployed
version) in the suite. The plugins/ copy's 7 tests all pass.
@OsherElhadad
OsherElhadad merged commit d9a3caf into main Aug 12, 2026
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant