Conversation
Contributor
Overall package sizeSelf size: 5.07 MB Dependency sizes| name | version | self size | total size | |------|---------|-----------|------------| | import-in-the-middle | 3.0.0 | 81.15 kB | 815.98 kB | | dc-polyfill | 0.1.10 | 26.73 kB | 26.73 kB |🤖 This report was automatically generated by heaviest-objects-in-the-universe |
BenchmarksBenchmark execution time: 2026-03-30 12:44:21 Comparing candidate commit b84b08e in PR branch Found 9 performance improvements and 5 performance regressions! Performance is the same for 216 metrics, 30 unstable metrics. scenario:appsec-iast-no-vulnerability-control-18
scenario:appsec-iast-no-vulnerability-control-24
scenario:appsec-iast-with-vulnerability-control-18
scenario:appsec-iast-with-vulnerability-control-22
scenario:appsec-iast-with-vulnerability-control-24
scenario:net-control-18
scenario:net-control-24
scenario:net-with-tracer-24
scenario:plugin-http-server-querystring-obfuscation-18
scenario:plugin-http-server-querystring-obfuscation-24
scenario:shimmer-runtime-asyncarrow-wrap-22
|
Codecov Report❌ Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## master #7844 +/- ##
==========================================
- Coverage 74.40% 74.35% -0.05%
==========================================
Files 768 768
Lines 35834 35855 +21
==========================================
Hits 26661 26661
- Misses 9173 9194 +21 Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
|
✅ Tests 🎉 All green!❄️ No new flaky tests detected 🎯 Code Coverage (details) 🔗 Commit SHA: 0e0d07b | Docs | Datadog PR Page | Was this helpful? React with 👍/👎 or give us feedback! |
cbasitodx
changed the title
Collaborator
juan-fernandez
left a comment
juan-fernandez
left a comment
There was a problem hiding this comment.
good job! Some nitpick and a comment about test coverage
Co-authored-by: Juan Antonio Fernández de Alba <fernandez.alba.juan@gmail.com>
Collaborator
E2E Test Report: SUCCESS ✅Tested by: Shepherd Agent (autonomous QA for Datadog Test Optimization) Test Environment
Results
Test MethodologyExpress playground (Mocha):
decap-cms playground (Jest):
Issues Found
This E2E test was performed by Shepherd — autonomous QA agent for Datadog Test Optimization |
Collaborator
juan-fernandez
left a comment
juan-fernandez
left a comment
There was a problem hiding this comment.
great job! I left some minor comments
integration-tests/ci-visibility/mocha-hooks/test-quarantine-with-failing-after-each.js
Show resolved
Hide resolved
Merged
juan-fernandez
pushed a commit
that referenced
this pull request
Apr 1, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What does this PR do?
Create a
@test.final_statustag that is added to every mocha test event that represents the final execution of that test (there can be multiple executions of a single test due to retry mechanisms being active)Motivation
Tracers send each test execution as a span to the backend. When retry mechanisms are enabled a single test can run several times with different outcomes. These mechanisms differ in behavior. Some stop once the test reaches the desired state such as ATR ending when a test passes. Others always run a fixed number of attempts such as EFD or Attempt to fix.
To ensure the correct final result for the customer some intermediate outcomes are suppressed and the testing framework receives an adjusted final status. For example if an early EFD attempt passes but later attempts fail the test is still reported as passed and the failing attempts are hidden to avoid failing CI pipelines.
Both external and internal users have requested a way to query tests in Datadog by this final status. Their main goal is to build monitors and alerts for hard failures on default branches.
To support this a new tag will be added to the last retry of a test named:
@test.final_status:pass|fail|skip