Add Cloudflare Analytics Worker to collect TTFB (Time To First Byte) metrics from the FilBeam bot. by ankur12-1610 · Pull Request #338 · filbeam/worker

ankur12-1610 · 2025-10-08T19:43:01Z

Add a Cloudflare Analytics Worker, required to collect and send Time To First Byte (TTFB) metrics to the FilBeam bot.

juliangruber

Great work! 🙏

juliangruber · 2025-10-09T08:17:35Z

analytics/bin/analytics-worker.js

+   * @param {unknown} error - The error object to extract from.
+   * @returns {{ status: number; message: string }}
+   */
+  _getErrorHttpStatusMessage(error) {


looks like we don't need the error handler in this worker, could you remove it and replace fetch with _fetch?

analytics-writer/README.md

bajtos

@juliangruber @ankur12-1610 IIUC, the current implementation creates an endpoint that allows anyone to write data to our CF Analytics Engine. Are we okay with that?

juliangruber · 2025-10-09T09:27:44Z

great catch, no we will need secrets

ankur12-1610 · 2025-10-09T12:35:00Z

@juliangruber @ankur12-1610 IIUC, the current implementation creates an endpoint that allows anyone to write data to our CF Analytics Engine. Are we okay with that?

yeah exactly, raised a PR so we can continue this discussion (filbeam/bot#33 (comment)) here

juliangruber · 2025-10-09T12:42:15Z

Since the filbeam/bot is deployed outside of CF, we can't easily use private networking, so indeed we will need an authentication strategy, most easily checking a secret stored in CF secrets

ankur12-1610 · 2025-10-13T06:05:54Z

@juliangruber @bajtos I have added secret based auth in the recent commit.

vitest.workspace.js

juliangruber · 2025-10-14T06:32:20Z

analytics-writer/worker-configuration.d.ts

This is missing the anlytics auth secret. I suspect that is because it's missing from wrangler.toml. Or maybe typings just need to be recreated

This is missing the anlytics auth secret. I suspect that is because it's missing from wrangler.toml. Or maybe typings just need to be recreated

@juliangruber I will need to add analytics auth secret to var in wrangler.toml as per the documentation of Cloudflare (https://developers.cloudflare.com/workers/configuration/environment-variables/#local-development-with-secrets) it is not advised.

bajtos · 2025-10-14T14:22:24Z

.github/workflows/ci.yml

+      - name: Deploy Analytics Worker
+        uses: cloudflare/wrangler-action@v3
+        with:
+          workingDirectory: analytics


Let's find a more descriptive name, please. analytics can mean many diferent things.

I propose to use the name analytics-writer to make it clear that this worker writes analytics entries.

Let's find a more descriptive name, please. analytics can mean many diferent things.

I propose to use the name analytics-writer to make it clear that this worker writes analytics entries.

Done.

bajtos · 2025-10-14T14:24:44Z

analytics/bin/analytics-worker.js

+     * @param {string} AUTH_HEADER_KEY Custom header to check for authentication
+     * @param {string} authKey Pre-shared authentication key from environment
+     */
+    const AUTH_HEADER_KEY = 'X-Analytics-Auth'


Is there any reason why we cannot use the standard Authorization header with the Bearer scheme?

POST / HTTP/1.1 Authorization: Bearer somesecret Content-Type: application/json (etc.)

hey so I was referring this https://developers.cloudflare.com/workers/examples/auth-with-headers/, I suppose we can set any custom header.

bajtos · 2025-10-14T14:28:45Z

analytics/bin/analytics-worker.js

+        blobs: data.blobs,   // [url, location, client, cid]
+        doubles: data.doubles // [ttfb, status, bytes]


We should allow the client to provide indexes as well, and validate that the array has at most one item.

See https://developers.cloudflare.com/analytics/analytics-engine/get-started/#2-write-data-points-from-your-worker

Indexes — (strings) — Used as a sampling key.
(...)
Currently, the writeDataPoint() API accepts ordered arrays of values. This means that you must provide fields in a consistent order. While the indexes field accepts an array, you currently must only provide a single index. If you attempt to provide multiple indexes, your data point will not be recorded.

Additional limits we may want to validate here:

https://developers.cloudflare.com/analytics/analytics-engine/limits/

We should allow the client to provide indexes as well, and validate that the array has at most one item.

See https://developers.cloudflare.com/analytics/analytics-engine/get-started/#2-write-data-points-from-your-worker

Indexes — (strings) — Used as a sampling key.
(...)
Currently, the writeDataPoint() API accepts ordered arrays of values. This means that you must provide fields in a consistent order. While the indexes field accepts an array, you currently must only provide a single index. If you attempt to provide multiple indexes, your data point will not be recorded.

Additional limits we may want to validate here:

https://developers.cloudflare.com/analytics/analytics-engine/limits/

I have added indexes and limits @bajtos

ankur12-1610 · 2025-11-06T16:29:17Z

@bajtos @juliangruber any updates on this, I intend to complete this issue.

Thanks!

bajtos · 2025-12-16T15:14:43Z

@ankur12-1610 I apologise for our unresponsiveness. We decided to shut down the FilBeam bot and rely solely on real traffic. We will need to find a different solution of measuring TTFB as observed by retrieval clients.

bajtos · 2025-12-16T15:15:48Z

@ankur12-1610 I appreciate the effort you put into this contribution ❤️

I am sorry we did not accept it in the end.

add ttfb worker

b714dbc

ankur12-1610 requested review from bajtos, juliangruber and pyropy as code owners October 8, 2025 19:43

ankur12-1610 mentioned this pull request Oct 8, 2025

Add Cloudflare Analytics Worker for TTFB metrics collection filbeam/bot#34

Closed

juliangruber requested changes Oct 9, 2025

View reviewed changes

bajtos reviewed Oct 9, 2025

View reviewed changes

Add secret based auth

0b1bca0

juliangruber requested review from bajtos and juliangruber October 14, 2025 06:29

juliangruber requested changes Oct 14, 2025

View reviewed changes

bajtos requested changes Oct 14, 2025

View reviewed changes

ankur12-1610 added 2 commits October 21, 2025 14:14

Merge branch 'filbeam:main' into main

e2c1956

Add indexes, limits and resolve nits

97759dd

ankur12-1610 force-pushed the main branch from 0ea135b to 97759dd Compare October 22, 2025 08:24

bajtos closed this Dec 16, 2025

		blobs: data.blobs, // [url, location, client, cid]
		doubles: data.doubles // [ttfb, status, bytes]

Conversation

ankur12-1610 commented Oct 8, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

juliangruber left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

bajtos left a comment

Choose a reason for hiding this comment

Uh oh!

juliangruber commented Oct 9, 2025

Uh oh!

ankur12-1610 commented Oct 9, 2025

Uh oh!

juliangruber commented Oct 9, 2025

Uh oh!

ankur12-1610 commented Oct 13, 2025

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

ankur12-1610 Oct 22, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

ankur12-1610 commented Nov 6, 2025

Uh oh!

bajtos commented Dec 16, 2025

Uh oh!

bajtos commented Dec 16, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

ankur12-1610 commented Oct 8, 2025 •

edited

Loading

ankur12-1610 Oct 22, 2025 •

edited

Loading