Update from main repo

.dockerignore

@@ -1,4 +1,12 @@
 .venv*
-localstack/node_modules/
-localstack/infra/
-localstack/dashboard/web/node_modules/
+
+.filesystem
+**/.filesystem
+
+# ignore files generated in CI build
+tests/aws/**/node_modules
+tests/aws/**/.terraform
+**/__pycache__
+target/
+htmlcov/
+.coverage

.git-blame-ignore-revs

@@ -0,0 +1,4 @@
+# format the codebase with black and isort
+8c006f122803dd06811343782b34f067f0622baf
+# reorganize utility package
+a7602821ac8666c9ab3a253457eb99570908ac8e

.github/CLA.md

@@ -0,0 +1,25 @@
+# Contributor License Agreement (CLA)
+
+This license is for your protection as a Contributor as well as the protection of the maintainers of the LocalStack software; it does not change your rights to use your own Contributions for any other purpose. In the following, the maintainers of LocalStack are referred to as "LocalStack".
+
+You accept and agree to the following terms and conditions for Your present and future Contributions submitted to "LocalStack". Except for the license granted herein to LocalSack and recipients of software distributed by "LocalStack", You reserve all right, title, and interest in and to Your Contributions.
+
+1. Definitions.
+
+   "You" (or "Your") shall mean the copyright owner or legal entity authorized by the copyright owner that is making this Agreement with "LocalStack". For legal entities, the entity making a Contribution and all other entities that control, are controlled by, or are under common control with that entity are considered to be a single Contributor.
+
+   "Contribution" shall mean any original work of authorship, including any modifications or additions to an existing work, that is intentionally submitted by You to "LocalStack" for inclusion in, or documentation of, any of the products owned or managed by "LocalStack" (the "Work"). For the purposes of this definition, "submitted" means any form of electronic, verbal, or written communication sent to "LocalStack" or its representatives, including but not limited to communication on electronic mailing lists, source code control systems, and issue tracking systems that are managed by, or on behalf of, "LocalStack" for the purpose of discussing and improving the Work, but excluding communication that is conspicuously marked or otherwise designated in writing by You as "Not a Contribution."
+
+2. Grant of Copyright License. Subject to the terms and conditions of this Agreement, You grant to "LocalStack" and to recipients of software distributed by "LocalStack" a perpetual, worldwide, non-exclusive, no-charge, royalty-free, irrevocable copyright license to reproduce, prepare derivative works of, publicly display, publicly perform, sublicense, and distribute Your Contributions and such derivative works.
+
+3. Grant of Patent License. Subject to the terms and conditions of this Agreement, You grant to "LocalStack" and to recipients of software distributed by "LocalStack" a perpetual, worldwide, non-exclusive, no-charge, royalty-free, irrevocable (except as stated in this section) patent license to make, have made, use, offer to sell, sell, import, and otherwise transfer the Work, where such license applies only to those patent claims licensable by You that are necessarily infringed by Your Contribution(s) alone or by combination of Your Contribution(s) with the Work to which such Contribution(s) was submitted.
+
+4. You represent that you are legally entitled to grant the above license. If your employer(s) has rights to intellectual property that you create that includes your Contributions, you represent that you have received permission to make Contributions on behalf of that employer, that your employer has waived such rights for your Contributions to "LocalStack", or that your employer has executed a separate Contributor License Agreement with "LocalStack".
+
+5. You represent that each of Your Contributions is Your original creation (see section 7 for submissions on behalf of others). You represent that Your Contribution submissions include complete details of any third-party license or other restriction (including, but not limited to, related patents and trademarks) of which you are personally aware and which are associated with any part of Your Contributions.
+
+6. You are not expected to provide support for Your Contributions, except to the extent You desire to provide support. Unless required by applicable law or agreed to in writing, You provide Your Contributions on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied, including, without limitation, any warranties or conditions of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A PARTICULAR PURPOSE.
+
+7. Should You wish to submit work that is not Your original creation, You may submit it to "LocalStack" separately from any Contribution, identifying the complete details of its source and of any license or other restriction (including, but not limited to, related patents, trademarks, and license agreements) of which you are personally aware, and conspicuously marking the work as "Submitted on behalf of a third-party: [named here]".
+
+8. You agree to notify "LocalStack" of any facts or circumstances of which you become aware that would make these representations inaccurate in any respect.

.github/FUNDING.yml

@@ -0,0 +1,3 @@
+# These are supported funding model platforms
+
+open_collective: localstack

.github/ISSUE_TEMPLATE/bug-report.yml

@@ -0,0 +1,86 @@
+name: 🐞 Bug
+description: File a bug/issue
+title: "bug: <title>"
+labels: ["type: bug", "status: triage needed"]
+body:
+- type: markdown
+  attributes:
+    value: |
+      Thanks for taking the time to fill out this bug! If you need real-time help, join us in the [community Slack](https://localstack-community.slack.com).
+- type: checkboxes
+  attributes:
+    label: Is there an existing issue for this?
+    description: Please search to see if an issue already exists for the bug you encountered.
+    options:
+    - label: I have searched the existing issues
+      required: true
+- type: textarea
+  attributes:
+    label: Current Behavior
+    description: A concise description of what you're experiencing.
+  validations:
+    required: true
+- type: textarea
+  attributes:
+    label: Expected Behavior
+    description: A concise description of what you expected to happen.
+  validations:
+    required: false
+- type: dropdown
+  attributes:
+    label: How are you starting LocalStack?
+    options:
+      - With a docker-compose file
+      - With a `docker run` command
+      - With the `localstack` script
+      - Custom (please describe below)
+  validations:
+    required: true
+- type: textarea
+  attributes:
+    label: Steps To Reproduce
+    description: Steps to reproduce the behavior.
+    value: |
+      #### How are you starting localstack (e.g., `bin/localstack` command, arguments, or `docker-compose.yml`)
+
+          docker run localstack/localstack
+
+      #### Client commands (e.g., AWS SDK code snippet, or sequence of "awslocal" commands)
+
+          awslocal s3 mb s3://mybucket
+
+  validations:
+    required: true
+- type: textarea
+  attributes:
+    label: Environment
+    description: |
+      examples:
+        - **OS**: Ubuntu 20.04
+        - **LocalStack**:
+          You can find this information in the logs when starting localstack
+
+          LocalStack version: 3.4.1.dev
+          LocalStack Docker image sha: sha256:f02ab8ef73f66b0ab26bb3d24a165e1066a714355f79a42bf8aa1a336d5722e7
+          LocalStack build date: 2024-05-14
+          LocalStack build git hash: ecd7dc879
+
+    value: |
+        - OS:
+        - LocalStack:
+          LocalStack version:
+          LocalStack Docker image sha:
+          LocalStack build date:
+          LocalStack build git hash:
+    render: markdown
+  validations:
+    required: false
+- type: textarea
+  attributes:
+    label: Anything else?
+    description: |
+      Links? References? Anything that will give us more context about the issue you are encountering!
+
+      Tip: You can attach images or log files by clicking this area to highlight it and then dragging files in.
+  validations:
+    required: false

.github/ISSUE_TEMPLATE/config.yml

@@ -0,0 +1,8 @@
+blank_issues_enabled: true
+contact_links:
+  - name: 📖  LocalStack Documentation
+    url: https://localstack.cloud/docs/getting-started/overview/
+    about: The LocalStack documentation may answer your questions!
+  - name: 💬  LocalStack Community Support (Slack)
+    url: https://localstack.cloud/slack
+    about: Please ask and answer questions here.

.github/ISSUE_TEMPLATE/feature-request.yml

@@ -0,0 +1,36 @@
+name: ✨ Feature request
+description: Request a new feature
+title: "feature request: <title>"
+labels: ["type: feature", "status: triage needed"]
+body:
+- type: markdown
+  attributes:
+    value: |
+      Thanks for taking the time to improve LocalStack!
+- type: checkboxes
+  attributes:
+    label: Is there an existing issue for this?
+    description: Please search to see if an issue already exists for the feature you are requesting.
+    options:
+    - label: I have searched the existing issues
+      required: true
+- type: textarea
+  attributes:
+    label: Feature description
+    description: Please describe the feature you would like LocalStack to have
+  validations:
+    required: true
+- type: textarea
+  attributes:
+    label: 🧑‍💻 Implementation
+    description: If you are a developer and have an idea how to implement this feature, please sketch it out here.
+  validations:
+    required: false
+- type: textarea
+  attributes:
+    label: Anything else?
+    description: |
+      Links? References? Anything that will give us more context about the issue you are encountering!
+      Tip: You can attach images or log files by clicking this area to highlight it and then dragging files in.
+  validations:
+    required: false

.github/PULL_REQUEST_TEMPLATE.md

@@ -1 +1,24 @@
-**Please refer to the contribution guidelines in the README when submitting PRs.**
+<!-- Please refer to the contribution guidelines before raising a PR: https://github.com/localstack/localstack/blob/master/docs/CONTRIBUTING.md -->
+
+<!-- Why am I raising this PR? Add context such as related issues, PRs, or documentation. -->
+## Motivation
+
+
+<!-- What changes does this PR make? How does LocalStack behave differently now? -->
+## Changes
+
+<!-- Optional section: How to test these changes? -->
+<!--
+## Testing
+
+-->
+
+<!-- Optional section: What's left to do before it can be merged? -->
+<!--
+## TODO
+
+What's left to do:
+
+- [ ] ...
+- [ ] ...
+-->

.github/actions/build-image/action.yml

@@ -0,0 +1,63 @@
+name: 'Build Image'
+description: 'Composite action which combines all steps necessary to build the LocalStack Community image.'
+inputs:
+  dockerhubPullUsername:
+    description: 'Username to log in to DockerHub to mitigate rate limiting issues with DockerHub.'
+    required: false
+  dockerhubPullToken:
+    description: 'API token to log in to DockerHub to mitigate rate limiting issues with DockerHub.'
+    required: false
+  disableCaching:
+    description: 'Disable Caching'
+    required: false
+outputs:
+  image-artifact-name:
+    description: "Name of the artifact containing the built docker image"
+    value: ${{ steps.image-artifact-name.outputs.image-artifact-name }}
+runs:
+  using: "composite"
+  # This GH Action requires localstack repo in 'localstack' dir + full git history (fetch-depth: 0)
+  steps:
+    - name: Set up Python
+      uses: actions/setup-python@v5
+      with:
+        python-version-file: 'localstack/.python-version'
+
+    - name: Install docker helper dependencies
+      shell: bash
+      run: pip install --upgrade setuptools setuptools_scm
+
+    - name: Login to Docker Hub
+      # login to DockerHub to avoid rate limiting issues on custom runners
+      uses: docker/login-action@v3
+      if: ${{ inputs.dockerHubPullUsername != '' && inputs.dockerHubPullToken != '' }}
+      with:
+        username: ${{ inputs.dockerhubPullUsername }}
+        password: ${{ inputs.dockerhubPullToken }}
+
+    - name: Build Docker Image
+      id: build-image
+      shell: bash
+      env:
+        DOCKER_BUILD_FLAGS: "--load ${{ inputs.disableCaching == 'true' && '--no-cache' || '' }}"
+        PLATFORM: ${{ (runner.arch == 'X64' && 'amd64') || (runner.arch == 'ARM64' && 'arm64') || '' }}
+        DOCKERFILE: ../Dockerfile
+        DOCKER_BUILD_CONTEXT: ..
+        IMAGE_NAME: "localstack/localstack"
+      working-directory: localstack/localstack-core
+      run: |
+        ../bin/docker-helper.sh build
+        ../bin/docker-helper.sh save
+
+    - name: Store Docker Image as Artifact
+      uses: actions/upload-artifact@v4
+      with:
+        name: localstack-docker-image-${{ (runner.arch == 'X64' && 'amd64') || (runner.arch == 'ARM64' && 'arm64') || '' }}
+        # the path is defined by the "save" command of the docker-helper, which sets a GitHub output "IMAGE_FILENAME"
+        path: localstack/localstack-core/${{ steps.build-image.outputs.IMAGE_FILENAME || steps.build-test-image.outputs.IMAGE_FILENAME}}
+        retention-days: 1
+
+    - name: Set image artifact name as output
+      id: image-artifact-name
+      shell: bash
+      run: echo "image-artifact-name=localstack-docker-image-${{ (runner.arch == 'X64' && 'amd64') || (runner.arch == 'ARM64' && 'arm64') || '' }}" >> $GITHUB_OUTPUT

.github/actions/load-localstack-docker-from-artifacts/action.yml

@@ -0,0 +1,31 @@
+name: 'Load Localstack Docker image'
+description: 'Composite action that loads a LocalStack Docker image from a tar archive stored in GitHub Workflow Artifacts into the local Docker image cache'
+inputs:
+  platform:
+    required: false
+    description: Target architecture for running the Docker image
+    default: "amd64"
+runs:
+  using: "composite"
+  steps:
+    - name: Download Docker Image
+      uses: actions/download-artifact@v4
+      with:
+        name: localstack-docker-image-${{ inputs.platform }}
+
+    - name: Set up Python
+      uses: actions/setup-python@v5
+      with:
+        python-version-file: '.python-version'
+        cache: 'pip'
+        cache-dependency-path: 'requirements-typehint.txt'
+
+    - name: Install docker helper dependencies
+      shell: bash
+      run: pip install --upgrade setuptools setuptools_scm
+
+    - name: Load Docker Image
+      shell: bash
+      env:
+        PLATFORM: ${{ inputs.platform }}
+      run: bin/docker-helper.sh load

.github/actions/setup-tests-env/action.yml

@@ -0,0 +1,22 @@
+name: 'Setup Test Environment'
+description: 'Composite action which combines all steps necessary to setup the runner for test execution'
+runs:
+  using: "composite"
+  steps:
+    - name: Set up Python
+      uses: actions/setup-python@v5
+      with:
+        python-version-file: '.python-version'
+        cache: 'pip'
+        cache-dependency-path: 'requirements-typehint.txt'
+
+    - name: Install Community Dependencies
+      shell: bash
+      run: make install-dev-types
+
+    - name: Setup environment
+      shell: bash
+      run: |
+        make install
+        mkdir -p target/reports
+        mkdir -p target/coverage

.github/bot_templates/ASF_UPGRADE_PR.md

@@ -0,0 +1,22 @@
+# 🚀 ASF Update Report 🚀
+This PR has been automatically generated to update the generated API stubs for our ASF services.
+It uses the latest code-generator from the _master_ branch ([scaffold.py](https://github.com/localstack/localstack/blob/master/localstack/aws/scaffold.py)) and the latest _published_ version of [botocore](https://github.com/boto/botocore) to re-generate all API stubs which are already present in the `localstack.aws.api` module of the _master_ branch.
+
+## 🔄 Updated Services
+This PR updates the following services:
+{{ SERVICES }}
+
+## 👷🏽 Handle this PR
+The following options describe how to interact with this PR / the auto-update:
+
+✔️ **Accept Changes**
+If the changes are satisfying, just squash-merge the PR and delete the source branch.
+
+🚫 **Ignore Changes**
+If you want to ignore the changes in this PR, just close the PR and *do not delete* the source branch. The PR will not be opened and a new PR will not be created for as long as the generated code does not change (or the branch is deleted). As soon as there are new changes, a new PR will be created.
+
+✏️ **Adapt Changes**
+*Don't do this.* The APIs are auto-generated. If you decide that the APIs should look different, you have to change the code-generation.
+
+⏸️ **Pause Updates**
+Remove the cron-schedule trigger of the GitHub Action workflow which creates these PRs. The action can then still be triggered manually, but it will not be executed automatically.

.github/bot_templates/MARKER_REPORT_ISSUE.md.j2

@@ -0,0 +1,36 @@
+---
+title: AWS Marker Report
+---
+# AWS Marker Report
+
+- Repository: {{ data.meta.repo_url }}
+- Reference Commit: `{{ data.meta.commit_sha }}`
+- Timestamp: `{{ data.meta.timestamp }}`
+
+This is an autogenerated report on our pytest marker usage with a special focus on our AWS compatibility markers, i.e. the ones prefixed with `aws_`.
+
+## Overview
+
+```text
+{% for name, count in data.aggregated.items() -%}
+{{ name }} : {{ count }}
+{% endfor -%}
+```
+
+Both `aws_unknown` and `aws_needs_fixing` should be reduced to `0` over time.
+If you have some spare capacity please take one of these tests, try it against AWS and see if it works. Replace `aws_unknown` with the correct marker.
+To avoid the case where two people are concurrently working on one test case, please tick the box to "claim" a case when you want to work on it.
+
+_Note_: The individual assignments here are based on the entries in the [CODEOWNERS]({{ data.meta.repo_url }}/blob/{{ data.meta.commit_sha }}/CODEOWNERS) file.
+
+## unknown ({{ data.aggregated['aws_unknown'] }})
+
+{% for item in data.owners_aws_unknown -%}
+- [ ] `{{ item.pytest_node_id }}` {{ " ".join(item.owners) }}
+{% endfor %}
+
+## needs_fixing ({{ data.aggregated['aws_needs_fixing'] }})
+
+{% for item in data.owners_aws_needs_fixing -%}
+- [ ] `{{ item.pytest_node_id }}` {{ " ".join(item.owners) }}
+{% endfor %}