Skip to content

Conversation

@bradleyshep
Copy link
Contributor

Description of Changes

Adds a comprehensive benchmarking suite for comparing SpacetimeDB performance against other databases and backends.

Key features:

  • Load testing framework that runs repeatable benchmarks across multiple connectors
  • Supports SpacetimeDB, PostgreSQL, CockroachDB, SQLite, Supabase, Convex, and Bun
  • Configurable test parameters: duration, concurrency, Zipf distribution (α) for hot/cold account skew
  • Outputs JSON reports with TPS and latency statistics to ./runs/
  • Docker Compose support for containerized benchmarking
  • Includes a test SpacetimeDB Rust module (modules/test-1/server)

Connectors included:

  • Direct SQL connectors (Postgres, CockroachDB, SQLite)
  • Drizzle ORM wrappers
  • RPC-based connectors for network-isolated benchmarking
  • SpacetimeDB WebSocket connector
  • Supabase and Convex cloud connectors

API and ABI breaking changes

None. This is a new standalone template with no changes to existing code.

Expected complexity level and risk

1 - This is an additive change that introduces a new isolated template folder. It has no interactions with existing SpacetimeDB crates or modules.

Testing

  • Run pnpm install in templates/keynote-2/
  • Verify SpacetimeDB module compiles: cd templates/keynote-2/modules/test-1/server && cargo build
  • Run a basic benchmark against SpacetimeDB (requires local SpacetimeDB instance)

bradleyshep and others added 8 commits January 21, 2026 09:03
… scripting

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
Signed-off-by: bradleyshep <148254416+bradleyshep@users.noreply.github.com>
…sensitive information

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
Signed-off-by: bradleyshep <148254416+bradleyshep@users.noreply.github.com>
…hrough a stack trace

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
Signed-off-by: bradleyshep <148254416+bradleyshep@users.noreply.github.com>
…hrough a stack trace

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
Signed-off-by: bradleyshep <148254416+bradleyshep@users.noreply.github.com>
…hrough a stack trace

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
Signed-off-by: bradleyshep <148254416+bradleyshep@users.noreply.github.com>
…hrough a stack trace

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
Signed-off-by: bradleyshep <148254416+bradleyshep@users.noreply.github.com>
…hrough a stack trace

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
Signed-off-by: bradleyshep <148254416+bradleyshep@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants