Skip to content

Add Distributed Partition Function (DPF) example notebook#263

Open
sfc-gh-mcoolsaet wants to merge 2 commits intoSnowflake-Labs:mainfrom
sfc-gh-mcoolsaet:add-dpf-sample
Open

Add Distributed Partition Function (DPF) example notebook#263
sfc-gh-mcoolsaet wants to merge 2 commits intoSnowflake-Labs:mainfrom
sfc-gh-mcoolsaet:add-dpf-sample

Conversation

@sfc-gh-mcoolsaet
Copy link

Summary

  • Adds an end-to-end example notebook demonstrating DPF for parallel data processing across compute pool nodes
  • Covers DataFrame mode (partition by column), Stage mode (partition by file), and ML Jobs deployment via @remote
  • Uses a supply chain allocation scenario (linear programming with scipy) as the example workload

@sfc-gh-mcoolsaet
Copy link
Author

@sfc-gh-shchen Can you review?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant