Skip to content

Ingest-smoke workflow: OIDC auth and dev S3 write #111

Description

@cursor

Parent

#105

Spec

spec/features/014-cicd-infrastructure/spec.md

What to build

Add a GitHub Actions workflow separate from PR CI:

  • Triggers: workflow_dispatch and weekly cron
  • Uses GitHub Environment dev and OIDC to assume smartwealthai-github-actions-dev role
  • Runs minimal ingestion (small ticker subset or test object) writing to s3://smartwealthai-data-lake-dev/raw/
  • Validates object presence and basic schema/count checks
  • Does not block PR merges on failure

Requires M2 Terraform outputs (dev bucket, dev role ARN) configured as GitHub Environment variables or discovered from AWS.

Acceptance criteria

  • Workflow authenticates via OIDC (no static AWS keys)
  • Successful run writes at least one object under dev bucket raw/ prefix
  • Failure surfaces in workflow status without blocking unrelated PRs
  • Documented in operator guide under infra/terraform/ or spec/guides/

Blocked by

#107, #108, #109

Type

AFK

Metadata

Metadata

Assignees

No one assigned

    Labels

    ci-cdCI/CD and AWS infrastructure slicesready-for-agentAFK agent can pick up

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions