Skip to content

Unify path adaptation for remote file sources#22336

Merged
davelopez merged 1 commit intogalaxyproject:devfrom
davelopez:unify_fsspec_path_handling
Apr 5, 2026
Merged

Unify path adaptation for remote file sources#22336
davelopez merged 1 commit intogalaxyproject:devfrom
davelopez:unify_fsspec_path_handling

Conversation

@davelopez
Copy link
Copy Markdown
Contributor

Refactors the remote file source adapters to consistently handle translation between virtual entry paths and physical filesystem paths. Introduces and standardizes methods to convert between virtual and storage-specific paths. Removes redundant or duplicate code, eliminates unnecessary intermediate path conversion helpers, and ensures that path adaptation logic always receives the resolved configuration context with resolved templates for configuration values (addressing #21646 (comment)).

How to test the changes?

  • I've included appropriate automated tests.
  • This is a refactoring of components with existing test coverage.
  • Instructions for manual testing are as follows:
    1. [add testing steps and prerequisites here if you didn't write automated tests covering all your changes]

License

  • I agree to license these and all my past contributions to the core galaxy codebase under the MIT license.

Refactors the remote file source adapters to consistently handle translation between virtual entry paths and physical filesystem paths. Introduces and standardizes methods to convert between virtual and storage-specific paths for S3, Azure, Google Cloud Storage, Hugging Face, SSH, and temporary file sources. Removes redundant or duplicate code, eliminates unnecessary intermediate path conversion helpers, and ensures that path adaptation logic always receives the configuration context it requires.
@davelopez davelopez added kind/refactoring cleanup or refactoring of existing code, no functional changes area/backend labels Mar 31, 2026
@github-actions github-actions bot added this to the 26.1 milestone Mar 31, 2026
@davelopez davelopez merged commit 65e8958 into galaxyproject:dev Apr 5, 2026
59 of 61 checks passed
@github-project-automation github-project-automation bot moved this from Needs Review to Done in Galaxy Dev - weeklies Apr 5, 2026
@davelopez davelopez deleted the unify_fsspec_path_handling branch April 5, 2026 10:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/backend kind/refactoring cleanup or refactoring of existing code, no functional changes

Projects

Development

Successfully merging this pull request may close these issues.

2 participants