Skip to content

Add non-record 11L XSA4 EMA run (val_bpb 1.12296, over 16MB)#416

Open
kshitizz36 wants to merge 1 commit intoopenai:mainfrom
kshitizz36:codex/nonrecord-modal-112296
Open

Add non-record 11L XSA4 EMA run (val_bpb 1.12296, over 16MB)#416
kshitizz36 wants to merge 1 commit intoopenai:mainfrom
kshitizz36:codex/nonrecord-modal-112296

Conversation

@kshitizz36
Copy link

Summary

records/track_non_record_16mb/2026-03-22_11L_XSA4_EMA_Modal_1.12296_Over16MB/

Why non-record

This run is not leaderboard-eligible due to size:

  • final_int6_sliding_window_exact val_bpb: 1.12296159
  • Total submission size int6+zstd: 20,906,280 bytes (> 16,000,000 limit)

Included files

  • README.md
  • submission.json
  • train.log
  • train_gpt.py

Key details

  • 8x H100, 600s wallclock
  • stopped at step:6900, step_avg:86.96ms
  • final_int6_roundtrip_exact val_bpb: 1.14634024
  • final_int6_sliding_window_exact val_bpb: 1.12296159

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant