Skip to content
This repository was archived by the owner on Jul 16, 2024. It is now read-only.
This repository was archived by the owner on Jul 16, 2024. It is now read-only.

Implement a Dwh construct to abstract Redshift and helpers #392

Description

@vgkowski

Currently, there is no Dwh abstraction in the Analytics Reference Architecture and you need to provision Redshift L2 Construct with lots of additional resources to get a complete and usable setup.

We can implement a new construct called Dwh which bundle all the required resources with defaults but still customizable. It can be composed of:

  • Redshift cluster with a default parameter group (multiple priority queues, concurrency scaling,
  • KMS key for data encryption
  • Bucket for logs (should be an AraBucket singleton 'redshift-access-logs')
  • Default WLM configuration
  • IAM role for Spectrum
  • Schema pointing to Glue catalog
  • Default users for ETL, data engineer, data analyst, data scientist

Points to be investigated:

  • L2 alpha versus L1 Cfn based construct
  • Need for SSL enforcement
  • IAM authentication vs secret manager username/password

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requestredshiftComponents used in Redshift abstractions

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions