Skip to content

Utilities for file handling - Temp file writer #91

@jbusecke

Description

@jbusecke

It would be nice to have some utilities for handling temporary file writing in a flexible way.

I have written multiple attemps for such functions. Here are the key features I would like to have.

  1. Keeping track of written paths. This is especially important for zarr stores, to avoid accidental rm -rf distasters
  2. Splitting a large input dataset along a given dimension and write those out as seperate files/stores
  3. Checking for existing files, printing filepaths and showing progress (this can all be nicely handled with a decorator I think).

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions