Update netcdf clobber mode for MPAS global and regional stats streams#8347
Open
stephenprice wants to merge 5 commits into
Open
Update netcdf clobber mode for MPAS global and regional stats streams#8347stephenprice wants to merge 5 commits into
stephenprice wants to merge 5 commits into
Conversation
for improved performance in multidecadal simulations.
…streams-for-stats
stephenprice
added
MPAS-albany-landice
Contributor
Author
|
Note that I'm in the middle of testing this right now, both with the 'truncate' and 'overwrite' settings in place. Mainly, I wanted to get the PR open again for discussion with the new branch name. |
stephenprice
changed the title
Based on testing, reverting mpas-o settings to previous values and altering mali values to be similar to those for mpas-o. That is, set so that mali global and regional stats files are written out monthly with 'truncate' as the clobber mode.
Contributor
Author
|
Based on testing and further discussion, the following updates have been made:
|
trhille
approved these changes
May 4, 2026
Contributor
There was a problem hiding this comment.
Thanks @stephenprice! I've compared these with the mpas-ocean settings and they are indeed the same, which was the goal.
matthewhoffman
approved these changes
May 4, 2026
Contributor
matthewhoffman
left a comment
matthewhoffman
left a comment
There was a problem hiding this comment.
@stephenprice , thanks for the additional adjustments. These details look exactly what we settled on in our follow up discussion.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
For multidecadal simulations with MALI active in E3SM, degraded performance was observed after several decades of simulation (approx. 50% less SYPD after 70 years). This degradation was eventually linked back to poor I/O performance when MALI writes repeatedly to the same global and/or regional stats file(s). Initial performance was recovered by changing these settings to write a single global and regional stats file for each year of simulation. Testing confirmed changes work for short simulations (e.g., several days with daily file writes) and a year-long test is pending completion.
This PR is updated to also include changes to the globalStats file for mpas-ocean (original PR here; branch renamed to reflect broader changes).