Skip to content

Leaderboard: RoRa + Electric Beatle resubmits, +UTDA, blocker notes#82

Open
willpartcl wants to merge 1 commit into
mainfrom
update-leaderboard-may1
Open

Leaderboard: RoRa + Electric Beatle resubmits, +UTDA, blocker notes#82
willpartcl wants to merge 1 commit into
mainfrom
update-leaderboard-may1

Conversation

@willpartcl
Copy link
Copy Markdown
Contributor

Summary

New entry:

  • UTDA (Phase 12 Multi-start CD+LNS) — chuanqi.chen@utexas.edu, self-reported 1.5767, 57s/bench, multi-start CD+LNS with numba-accelerated proxy. Rank 26.

Resubmissions:

  • RoRa — was RipPlace 1.3241 (blocked on `place(plc=...)` signature). New: RoomPlace, self-reported 1.2723, ~700s/bench. Now rank 2 pending re-verification.
  • Electric Beatle — was verified 1.3913. New: ePlace-Lite with Adam-based stochastic descent + multi-start hyperparameter sweep, self-reported 1.3253, 2000s/bench (GPU). Now rank 4; verified marker dropped pending re-verification.

Blocker notes added inline for Pragnay, Adi's Team, W3 Solutions, and "another Waterloo kid" so the leaderboard shows what's gating each entry without needing a separate doc.

Test plan

  • Leaderboard renders cleanly
  • Ranks consistent with avg-proxy ordering
  • Re-verify RoRa once we confirm the signature bug is fixed in RoomPlace
  • Re-verify Electric Beatle once we run the new ePlace-Lite

🤖 Generated with Claude Code

New entries:
- UTDA (Phase 12 Multi-start CD+LNS) — chuanqi.chen@utexas.edu;
  self-reported 1.5767, 57s/bench, multi-start CD+LNS with numba-
  accelerated proxy. Inserted at rank 26.

Resubmissions:
- RoRa: was RipPlace 1.3241 (blocked on `place(plc=...)` signature).
  New submission RoomPlace, self-reported 1.2723, ~700s/bench. Moves
  from rank 4 to rank 2 pending re-verification.
- Electric Beatle: was verified 1.3913. New submission still ePlace-Lite
  but with Adam-based stochastic descent + multi-start hyperparameter
  sweep, self-reported 1.3253, 2000s/bench (GPU). Moves from rank 9 to
  rank 4; verified marker dropped pending re-verification.

Also added blocker notes inline for Pragnay, Adi's Team, W3 Solutions,
and "another Waterloo kid" so the leaderboard reflects what's gating
each entry without requiring a separate doc.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant