Add a comment in eri.py about a possible error this can catch#4959
Conversation
|
I wasn't sure where the best place would be to put this comment to give the best chance that someone will actually find it when they need it, so I welcome input on a better place to put it - as well as any comments to help clarify the wording. |
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## master #4959 +/- ##
==========================================
- Coverage 28.32% 28.29% -0.04%
==========================================
Files 262 262
Lines 38340 38384 +44
Branches 8114 8126 +12
==========================================
Hits 10860 10860
- Misses 26234 26276 +42
- Partials 1246 1248 +2 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
mnlevy1981
left a comment
There was a problem hiding this comment.
What would you think about putting the comment in the test-type table on the system testing doc page? I think my preference would be to include it both in eri.py and in the documentation, though I'm always a little concerned about duplicating documentation and then in the future things get out of sync... that doesn't seem likely in this case, hence my thinking that it could go in both places.
|
@mnlevy1981 - good idea, thanks. I have made that change. |
mnlevy1981
left a comment
There was a problem hiding this comment.
This looks good to me - I like that you put this note in the case (Suffix branch) section of the description. I was expecting it at the bottom of the cell, and was confused when I couldn't find it until I realized how the rest of the cell was organized :)
Description
This was motivated by the discussion in #4859 . I realized that the ERI test can catch the type of error that the ERS2 was designed to catch - where the mere act of writing a restart file can lead to an answer change. I thought it was worth mentioning this, both so care is taken to maintain the ability of the ERI test to catch this kind of error, and to give some guidance for people who run into a failure in this comparison suggesting this possible cause.
Checklist