Improve large scale training file lists with distributed approach#26

Merged

FileSystemGuy merged 2 commits into

mainfrom

wdesalvador/mpi-rank0-listing

Jun 19, 2026

Commits on Jun 18, 2026

feat: MPI rank-0 streamed file listing with hash sharding and shared memory

wolfgang-desalvador
and
Copilot
committed

Commits on Jun 19, 2026

fix(sampler): guard ConfigArguments init against uninitialized MPI in unit tests
russfellows
committed