Skip to content

Updates to submission checker constants #2604

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
anandhu-eng wants to merge 11 commits into
base: master
Choose a base branch
from
Open

Updates to submission checker constants #2604

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
dada3c7
initial set of additions to submission checker constants
anandhu-eng Jun 18, 2026
26903ea
resolve conflicts
anandhu-eng Jun 18, 2026
b0adc5f
[Automated Commit] Format Codebase
bumper97birch Jun 18, 2026
11c602f
Add e2e_vectorDB + new required videos (#2605)
pgmpablo157321 Jun 19, 2026
7e94bdc
Update benchmark name: e2e->rag
pgmpablo157321 Jun 23, 2026
a84dbca
Add v6.1 random seeds
pgmpablo157321 Jun 23, 2026
aa65d76
Add SDXL seed + generate sample ids
pgmpablo157321 Jun 23, 2026
a441acf
Update sample IDs + remove rag_db file
pgmpablo157321 Jun 23, 2026
0f74ee7
Merge branch 'master' into submission_checker_constants_update
pgmpablo157321 Jun 23, 2026
60aaad1
[Automated Commit] Format Codebase
bumper97birch Jun 23, 2026
e94be68
Merge branch 'master' into submission_checker_constants_update
anandhu-eng Jun 24, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions loadgen/mlperf.conf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,9 +38,9 @@ gpt-oss-120b-interactive.*.performance_sample_count_override = 6396
gpt-oss-120b-interactive.*.accuracy_sample_count_override = 4395

# Set seeds.
*.*.qsl_rng_seed = 2465351861681999779
*.*.sample_index_rng_seed = 14276810075590677512
*.*.schedule_rng_seed = 3936089224930324775
*.*.qsl_rng_seed = 2085463073848966840
*.*.sample_index_rng_seed = 2747215439041700203
*.*.schedule_rng_seed = 16159082839903944936

# Set seeds for TEST_05 (not needed from v5.0 onwards)
*.*.test05_qsl_rng_seed = 7975553102935885558
Expand Down
2 changes: 1 addition & 1 deletion text_to_image/tools/sample_ids.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ def get_args():
default=10,
help="Dataset download location")
parser.add_argument(
"--seed", "-s", type=int, default=1999337312, help="Dataset download location"
"--seed", "-s", type=int, default=3234044599, help="Dataset download location"
)
args = parser.parse_args()
return args
Expand Down
20 changes: 10 additions & 10 deletions text_to_image/tools/sample_ids.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,10 +1,10 @@
1311
2476
3644
2188
4114
52
388
1195
3427
2289
4475

@nvzhihanj nvzhihanj Jun 25, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems to be missing the 5 Random video as @wu6u3tw mentioned

@hanyunfan hanyunfan Jun 25, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@pgmpablo157321 Could you prepare for it, and we can do the generation in next WG meeting

3627
1046
4937
3867
1671
3789
1206
4111
3093
Loading
Loading