From c23f4c818476580180d5a1db89c2ecc0e822a941 Mon Sep 17 00:00:00 2001 From: Onyeka Nwamba Date: Wed, 27 May 2026 00:09:36 +0100 Subject: [PATCH] ci: disable AgentRail telemetry in the test workflow Test runs in GitHub Actions have been firing real telemetry events to our production PostHog project. Each CI run creates dozens of fresh random install IDs and emits runner-related events through the real PostHog sink (any test that doesn't inject a mock telemetry client falls back to the disk-config CLI telemetry path). The result is that our PostHog data is a mix of real users, dogfooded local installs, and CI noise. The "39 codex failures from 32 unique installs" we used to scope recent fixes likely includes a meaningful fraction of CI runs, and we cannot tell them apart after the fact. Setting AGENTRAIL_TELEMETRY_DISABLED=1 at the job level forces every test in the workflow to use the noop sink, so future PRs stop polluting production analytics. A follow-up should audit which tests omit an injected sink and fix those at the test level too, so we are not relying solely on the env var. --- .github/workflows/ci.yml | 2 ++ 1 file changed, 2 insertions(+) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml index adb75c7..07ddffe 100644 --- a/.github/workflows/ci.yml +++ b/.github/workflows/ci.yml @@ -12,6 +12,8 @@ jobs: test: name: Test runs-on: ubuntu-latest + env: + AGENTRAIL_TELEMETRY_DISABLED: "1" steps: - uses: actions/checkout@v4 - name: Use Node.js 22