Immutable folder support in DABs by andrewnester · Pull Request #5254 · databricks/cli

andrewnester · 2026-05-15T09:56:18Z

Changes

Added support for deploying bundles to immutable folders in the workspace

When experimental.immutable_folder: true is set, the CLI packages all bundle source files and built artifacts into a single zip archive and uploads it as a content-addressed, immutable snapshot. The snapshot path is derived from the content hash of the zip, so identical code always lands at the same location and re-deploying an unchanged bundle is a no-op at the storage layer.

This mode is currently supported with the direct deployment engine only (DATABRICKS_BUNDLE_ENGINE=direct).

Example databricks.yml:

bundle:
  name: my-bundle

experimental:
  immutable_folder: true

resources:
  jobs:
    my_job:
      name: my-job
      tasks:
        - task_key: main
          python_script_task:
            python_file: ./src/main.py

After bundle deploy, the job's python_file resolves to a path like:

/Workspace/Users/[UUID]/.snapshots///src/files/src/main.py

Tests

Added an acceptance tests

eng-dev-ecosystem-bot · 2026-05-28T11:17:06Z

Integration test report

Commit: a601876

Run: 28177935465

	Env	🟨KNOWN	💚RECOVERED	🙈SKIP	✅pass	🙈skip	Time
🟨	aws linux	7	1	13	240	1030	5:34
🟨	aws windows	7	1	13	242	1028	8:38
💚	aws-ucws linux		8	13	327	947	5:07
💚	aws-ucws windows		8	13	329	945	6:16
💚	azure linux		2	15	243	1028	4:46
💚	azure windows		2	15	245	1026	5:38
💚	azure-ucws linux		2	15	332	943	5:12
💚	azure-ucws windows		2	15	334	941	5:46
💚	gcp linux		2	15	242	1030	4:04
💚	gcp windows		2	15	244	1028	5:39

21 interesting tests: 13 SKIP, 7 KNOWN, 1 RECOVERED

	Test Name	aws linux	aws windows	aws-ucws linux	aws-ucws windows	azure linux	azure windows	azure-ucws linux	azure-ucws windows	gcp linux	gcp windows
🟨	TestAccept	🟨K	🟨K	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
🙈	TestAccept/bundle/invariant/no_drift	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/permissions	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions	🟨K	🟨K	💚R	💚R	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=direct	🟨K	🟨K	💚R	💚R
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=terraform	🟨K	🟨K	💚R	💚R
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions	🟨K	🟨K	💚R	💚R	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=direct	🟨K	🟨K	💚R	💚R
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=terraform	🟨K	🟨K	💚R	💚R
🙈	TestAccept/bundle/resources/postgres_branches/basic	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_branches/recreate	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_branches/replace_existing	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_branches/update_protected	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_branches/without_branch_id	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_endpoints/basic	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/postgres_projects/update_display_name	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/synced_database_tables/basic	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/vector_search_endpoints/drift/recreated_same_name	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/bundle/resources/vector_search_indexes/recreate/embedding_dimension	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🙈	TestAccept/ssh/connection	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
💚	TestFetchRepositoryInfoAPI_FromRepo	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R

Top 4 slowest tests (at least 2 minutes):

duration	env	testname
3:58	aws-ucws windows	TestAccept
3:38	gcp windows	TestAccept
3:20	azure windows	TestAccept
3:12	azure-ucws windows	TestAccept

shreyas-goenka

Minor comments - other than the bit where we use metadata.json

shreyas-goenka · 2026-06-02T16:30:01Z

@@ -15,6 +15,9 @@ type Bundle struct {

 type Workspace struct {
 	FilePath string `json:"file_path"`
+	// SnapshotPath is the workspace path of the immutable snapshot uploaded
+	// during deployment. Only populated for bundles with bundle.immutable = true.
+	SnapshotPath string `json:"snapshot_path,omitempty"`


Will the UI use the immutable snapshot path? In that case we'll need to add it to DMS as well.

pietern

Please take a final pass on the remaining comments (this review and previous ones).

Immutable folder support in DABs

b685ec2

andrewnester requested a review from pietern May 15, 2026 09:56

andrewnester temporarily deployed to test-trigger-is May 15, 2026 09:56 — with GitHub Actions Inactive

andrewnester added 2 commits May 28, 2026 11:03

remove unused snapshot path method

a429b26

added an acceptance test

e7c1968

andrewnester temporarily deployed to test-trigger-is May 28, 2026 10:01 — with GitHub Actions Inactive

fix for notebook import

67914d0

andrewnester temporarily deployed to test-trigger-is May 28, 2026 10:19 — with GitHub Actions Inactive

removed unused function

549492a

andrewnester temporarily deployed to test-trigger-is May 28, 2026 10:41 — with GitHub Actions Inactive

andrewnester marked this pull request as ready for review June 1, 2026 11:34

fix schema + unit test

aedfdb0

andrewnester temporarily deployed to test-trigger-is June 1, 2026 11:39 — with GitHub Actions Inactive

andrewnester requested a review from denik June 2, 2026 10:01

shreyas-goenka reviewed Jun 2, 2026

View reviewed changes

andrewnester and others added 2 commits June 9, 2026 12:49

use immutable_folder config

eddec61

Merge branch 'main' into demo-immutable

27a6b02

andrewnester temporarily deployed to test-trigger-is June 9, 2026 10:51 — with GitHub Actions Inactive

remove merge conflict

4a9bcd9

andrewnester temporarily deployed to test-trigger-is June 9, 2026 10:53 — with GitHub Actions Inactive

fix empty artifact path + tests

ebd26ea

andrewnester temporarily deployed to test-trigger-is June 9, 2026 11:14 — with GitHub Actions Inactive

comment

5cefc2f

andrewnester temporarily deployed to test-trigger-is June 24, 2026 13:32 — with GitHub Actions Inactive

andrewnester requested a review from pietern June 24, 2026 13:32

fix test on windows

55acaf4

andrewnester temporarily deployed to test-trigger-is June 24, 2026 14:11 — with GitHub Actions Inactive

added client side validation for size of upload

60e41d3

andrewnester temporarily deployed to test-trigger-is June 24, 2026 14:56 — with GitHub Actions Inactive

fix lint

3d39f44

andrewnester temporarily deployed to test-trigger-is June 25, 2026 09:28 — with GitHub Actions Inactive

andrewnester enabled auto-merge June 25, 2026 11:52

pietern approved these changes Jun 25, 2026

View reviewed changes

Comment thread bundle/phases/initialize.go

Comment thread bundle/phases/build.go

andrewnester added this pull request to the merge queue Jun 25, 2026

pietern removed this pull request from the merge queue due to a manual request Jun 25, 2026

renamed variable

b9e3046

andrewnester temporarily deployed to test-trigger-is June 25, 2026 13:52 — with GitHub Actions Inactive

moved lib resolution to later stage

cdbb94e

andrewnester temporarily deployed to test-trigger-is June 25, 2026 14:06 — with GitHub Actions Inactive

fix lint

6a55056

andrewnester enabled auto-merge June 25, 2026 14:10

andrewnester temporarily deployed to test-trigger-is June 25, 2026 14:11 — with GitHub Actions Inactive

revert path resolution change

a601876

andrewnester temporarily deployed to test-trigger-is June 25, 2026 14:35 — with GitHub Actions Inactive

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Immutable folder support in DABs#5254

Immutable folder support in DABs#5254
andrewnester merged 34 commits into
mainfrom
demo-immutable

andrewnester commented May 15, 2026 •

edited

Loading

Uh oh!

eng-dev-ecosystem-bot commented May 28, 2026 •

edited

Loading

Uh oh!

shreyas-goenka left a comment

Uh oh!

Uh oh!

shreyas-goenka Jun 2, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

pietern left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Uh oh!

Conversation

andrewnester commented May 15, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Changes

Tests

Uh oh!

eng-dev-ecosystem-bot commented May 28, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Integration test report

Uh oh!

shreyas-goenka left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

shreyas-goenka Jun 2, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

pietern left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

andrewnester commented May 15, 2026 •

edited

Loading

eng-dev-ecosystem-bot commented May 28, 2026 •

edited

Loading