Temporarily loosen conformance ratchet to 99% / 1 FP after upstream enum-expansion test broadening - #414
Closed
abdushakoor12 wants to merge 2 commits into
Closed
Temporarily loosen conformance ratchet to 99% / 1 FP after upstream enum-expansion test broadening#414abdushakoor12 wants to merge 2 commits into
abdushakoor12 wants to merge 2 commits into
Conversation
…roadened enum-expansion tests (python/typing#2324); homepage shows measured 99.3% with a note
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
TLDR
Temporarily loosens the conformance ratchet (
threshold100→99,max_false_positives0→1) to unblock the v0.40.0 release after upstream broadened the enum-expansion conformance tests (python/typing#2324), and updates the homepage to show the real measured score (99.3%) with a note.What Was Changed or Deleted?
coverage-thresholds.json: conformance gate at 99% / 1 FP with a dated_temporary_exceptionnote — to be restored to 100 / 0 once the enum literal-union equivalence fix lands./zh/): hero leads with the fresh measured score plus a note whenever the latest run isn't perfect; the "only checker at 100%" framing returns automatically once it is.python/typing@mainharness run (commita490662):conformance_status.csv,conformance_report.json, stamped READMEs/spec at 99.3%.How Do The Automated Tests Prove It Works?
A local run of the unmodified upstream harness (
run_conformance.py --gate) passes the new gate: 140/141 files (99%), 1 false positive — the single new upstream test atenums_expansion.py:85(complete union of enum literal members ≡ enum type, not yet implemented).Breaking Changes
🤖 Generated with Claude Code