Skip to content

Commit 8ec90f8

Browse files
committed
Give the weekly difftest a fresh seed and a bigger budget
A fixed seed makes a weekly job re-check the same mutations forever, so it defaults to the run id now. And the budget was set before the run was measured: 3M checks take a minute and a half on four cores, so -per 60 -depth 3 is a few minutes for roughly 17M. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01JzBeCg7rjweVW3uGPg5G7T
1 parent 6484e8f commit 8ec90f8

1 file changed

Lines changed: 11 additions & 7 deletions

File tree

.github/workflows/difftest.yml

Lines changed: 11 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -14,11 +14,11 @@ on:
1414
workflow_dispatch:
1515
inputs:
1616
seed:
17-
description: "PRNG seed"
18-
default: "1"
17+
description: "PRNG seed (default: the run id, so each run is new ground)"
18+
default: ""
1919
per:
20-
description: "mutations per corpus case"
21-
default: "20"
20+
description: "mutations per input"
21+
default: "60"
2222

2323
jobs:
2424
difftest:
@@ -33,8 +33,12 @@ jobs:
3333
with:
3434
path: .sqlite
3535
key: sqlite-${{ hashFiles('internal/sqlitesrc/sqlitesrc.go', 'internal/sqlitesrc/oracle/oracle.c') }}
36+
# The seed defaults to the run id rather than to a constant: a weekly
37+
# job with a fixed seed re-checks the same mutations forever. Roughly
38+
# 17M checks, a few minutes on a four-core runner -- the oracle runs
39+
# as a pool of batch-mode processes, so the cost is nearly all meyer.
3640
- run: >
3741
go run ./cmd/difftest
38-
-per ${{ github.event.inputs.per || '20' }}
39-
-depth 2
40-
-seed ${{ github.event.inputs.seed || '1' }}
42+
-per ${{ github.event.inputs.per || '60' }}
43+
-depth 3
44+
-seed ${{ github.event.inputs.seed || github.run_id }}

0 commit comments

Comments
 (0)