Skip to content

[Feature](lance) Expand file TVF path and multi-dataset support #66492

Description

@Gabriel39

Parent

Tracked by #66340. The baseline s3() and local() Lance TVFs were introduced by #65730.

Scope

  • Expand glob patterns to multiple Lance datasets.
  • Read multiple Lance datasets in one TVF invocation.
  • Support additional file TVF entry points and broader path handling.
  • Preserve dataset boundaries, version pinning, schema compatibility, and secure path handling.

Completion criteria

  • FE split planning and BE execution support every selected dataset.
  • Tests cover glob expansion, mixed paths, multiple datasets, and incompatible schemas.
  • User documentation describes supported TVFs, paths, and limitations.
  • Representative local and object-storage paths are verified.

Metadata

Metadata

Assignees

No one assigned

    Labels

    area/catalogIssues or PRs related to catalog managementkind/featureCategorizes issue or PR as related to a new feature.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions