Skip to content

optimization of partition folder rename operations for ctas and inser…#385

Open
chandrasekhar-kambham wants to merge 1 commit intoopenlookeng:masterfrom
chandrasekhar-kambham:master_work
Open

optimization of partition folder rename operations for ctas and inser…#385
chandrasekhar-kambham wants to merge 1 commit intoopenlookeng:masterfrom
chandrasekhar-kambham:master_work

Conversation

@chandrasekhar-kambham
Copy link
Copy Markdown
Contributor

@chandrasekhar-kambham chandrasekhar-kambham commented Sep 8, 2022

What type of PR is this?

/kind task

What does this PR do / why do we need it:

currently rename partition operations takes a long time during commit operation stage..
optimization of partition folder rename operations for ctas and insert operations.
observed 40-50% imporvement in CTAS flow
observed ~5% improvement in Insert flow

Which issue(s) this PR fixes:

Fixes #

Special notes for your reviewers:

@it-is-a-robot
Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: chandrasekhar-kambham
To complete the pull request process, please assign haochending
You can assign the PR to them by writing /assign @haochending in a comment when ready.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@it-is-a-robot
Copy link
Copy Markdown
Contributor

Welcome @chandrasekhar-kambham!

It looks like this is your first PR to openlookeng/hetu-core 🎉.

You will be prompted by a bot to use commands during the review process. Do not be afraid to follow the prompts! It is okay to experiment. Here is the bot commands documentation.

You can also check if openlookeng/hetu-core has its own contribution guidelines. We want to make sure your contribution gets all the attention it needs!

Thank you, and welcome to MindSpore. 😃

@chandrasekhar-kambham
Copy link
Copy Markdown
Contributor Author

/check-cla

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants