From c50d372967333230ee85e372904632062635b362 Mon Sep 17 00:00:00 2001 From: Christopher Tso Date: Mon, 27 Apr 2026 11:50:49 +0200 Subject: [PATCH] fix(test): raise pipeline-e2e timeout to 30s to eliminate suite-contention flake (#1169) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit The `eval pipeline e2e > runs full input → grade → bench pipeline` test spawns three sequential `bun apps/cli/src/cli.ts pipeline ...` subprocesses (input → grade → bench). In isolation it completes in ~7-12s, well under the 5000ms default per-test timeout, but under suite contention from `bun --filter agentv test` it routinely overshoots and times out. Bump the per-test timeout to 30s using `it(name, fn, timeout)` (Bun's test runner supports the numeric third-arg form). Other suite tests are not modified — only the test cited in the issue. Closes #1169 --- apps/cli/test/commands/eval/pipeline/pipeline-e2e.test.ts | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/apps/cli/test/commands/eval/pipeline/pipeline-e2e.test.ts b/apps/cli/test/commands/eval/pipeline/pipeline-e2e.test.ts index 23f94f023..d2412643f 100644 --- a/apps/cli/test/commands/eval/pipeline/pipeline-e2e.test.ts +++ b/apps/cli/test/commands/eval/pipeline/pipeline-e2e.test.ts @@ -62,5 +62,5 @@ describe('eval pipeline e2e', () => { const benchmark = JSON.parse(await readFile(join(OUT_DIR, 'benchmark.json'), 'utf8')); expect(benchmark.run_summary).toBeDefined(); - }); + }, 30_000); });