Skip to content

Add AWS DSQL destination connector#269

Draft
tonyxiao wants to merge 1 commit intov2from
aws-dsql
Draft

Add AWS DSQL destination connector#269
tonyxiao wants to merge 1 commit intov2from
aws-dsql

Conversation

@tonyxiao
Copy link
Copy Markdown
Collaborator

Summary

  • New destination-aws-dsql package — Postgres-wire-compatible destination using IAM auth via @aws-sdk/dsql-signer, adapted for DSQL limitations (no jsonb, no triggers, no generated columns, sequential DDL)
  • Terraform config in terraform/ to provision a DSQL cluster
  • demo/stripe-to-dsql.ts — one-liner demo that syncs Stripe → DSQL with built-in verification, auto-reads endpoint from terraform output

DSQL-specific adaptations

  • text instead of jsonb (DSQL doesn't support jsonb)
  • Sequential DDL (concurrent CREATE TABLE causes OC001 optimistic concurrency conflicts)
  • No triggers or generated columns — id extracted at insert time, _updated_at set explicitly
  • IAM auth via DsqlSigner.getDbConnectAdminAuthToken()

Verified

customers: 1000 rows
prices: 720 rows
products: 702 rows

Test plan

  • pnpm build passes
  • pnpm lint passes
  • End-to-end: node --import tsx demo/stripe-to-dsql.ts syncs 3 streams and verifies via SELECT

🤖 Generated with Claude Code

- New `packages/destination-aws-dsql` connector using IAM auth via
  `@aws-sdk/dsql-signer`, adapted for DSQL limitations (no jsonb,
  no triggers, no generated columns, sequential DDL)
- Terraform config in `terraform/` to provision a DSQL cluster
- `demo/stripe-to-dsql.ts` syncs Stripe data to DSQL with built-in
  verification queries, auto-reads endpoint from terraform output
- Registered `aws_dsql` in engine default connectors

Verified: 1000 customers, 720 prices, 702 products synced successfully.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Committed-By-Agent: claude
@tonyxiao tonyxiao changed the base branch from main to v2 April 10, 2026 15:46
tonyxiao pushed a commit that referenced this pull request Apr 15, 2026
#269)

Bumps the npm_and_yarn group with 1 update in the / directory: [fastify](https://github.com/fastify/fastify).


Updates `fastify` from 5.7.2 to 5.7.3
- [Release notes](https://github.com/fastify/fastify/releases)
- [Commits](fastify/fastify@v5.7.2...v5.7.3)

---
updated-dependencies:
- dependency-name: fastify
  dependency-version: 5.7.3
  dependency-type: direct:production
  dependency-group: npm_and_yarn
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant