[SPARK-56371][SQL] Support _metadata.row_index for V2 Parquet reads#55321

Draft

LuciferYang wants to merge 13 commits intoapache:masterfrom

LuciferYang:SPARK-56371

Commits on Apr 7, 2026

[SPARK-56171][SQL] Enable V2 file write path for non-partitioned DataFrame API writes and delete FallBackFileSourceV2
LuciferYang
committed
[SPARK-56175][SQL] FileTable implements SupportsPartitionManagement, catalog table loading, and gate removal
LuciferYang
committed
[SPARK-56174][SQL] Complete V2 file write path for DataFrame API
LuciferYang
committed
[SPARK-56176][SQL] V2-native ANALYZE TABLE/COLUMN with stats propagation to FileScan
LuciferYang
committed
[SPARK-56177][SQL] V2 file bucketing write support
LuciferYang
committed
[SPARK-56178][SQL] MSCK REPAIR TABLE for V2 file tables
LuciferYang
committed
[SPARK-56316][SQL] Support static partition overwrite for V2 file tables
LuciferYang
committed
[SPARK-56304][SQL] V2 ifPartitionNotExists support for file table INSERT INTO
LuciferYang
committed
[SPARK-56231][SQL] Bucket pruning and bucket join optimization for V2 file read path
LuciferYang
committed
[SPARK-56232][SQL][SS] V2 streaming read for FileTable (MICRO_BATCH_READ)
LuciferYang
committed
[SPARK-56233][SQL][SS] V2 streaming write for FileTable (STREAMING_WRITE)
LuciferYang
committed

Commits on Apr 8, 2026