Enable EVP flagevaluation system tests for Java

[leoromanovsky]

Motivation

Java needs the shared server-side EVP flagevaluation system-test contract enabled so APM reviewers can validate that Java evaluations produce the same backend-visible signal as the other SDKs. This PR provides the public system-tests companion for the Java SDK fanout.

Changes

• Enables tests/ffe/test_flag_eval_evp.py for Java spring-boot in manifests/java.yml at v1.64.0-SNAPSHOT.
• Leaves other Java weblogs marked irrelevant.
• Keeps the test implementation inherited from current system-tests main.

Decisions

• Enable only spring-boot because that is the Java weblog covered by the companion SDK validation.
• Keep this PR to the Java manifest surface; SDK behavior remains in DataDog/dd-trace-java#11639.
• Existing OTel metric coverage stays in tests/ffe/test_flag_eval_metrics.py; this PR is only for EVP flagevaluation.

Validation Evidence

System Tests

• Companion SDK PR: feat(openfeature): emit server-side EVP flagevaluation dd-trace-java#11639
• This PR enables the Java manifest surface used by that SDK PR for EVP flagevaluation validation.

[github-actions]

CODEOWNERS have been resolved as:

manifests/java.yml                                                      @DataDog/asm-java @DataDog/apm-java

[datadog-datadog-prod-us1-2]

 

✨ Fix all issues with BitsAI

⚠️ Warnings

🚦 2 Pipeline jobs failed

Testing the test | System Tests (java, dev) / End-to-end #1 / spring-boot 1     

🧪 8 Tests failed

tests.ffe.test_flag_eval_evp.Test_FFE_EVP_Flagevaluation_Basic.test_ffe_evp_flagevaluation_basic[spring-boot] from system_tests_suite  

AssertionError: Timed out waiting for EVP flagevaluation event for flag evp-basic-flag
assert False
 +  where False = <bound method ProxyBasedInterfaceValidator.wait_for of AgentInterfaceValidator('agent')>(<function wait_for_evp_flagevaluation_event.<locals>.<lambda> at 0x7f764cc22e80>, timeout=30)
 +    where <bound method ProxyBasedInterfaceValidator.wait_for of AgentInterfaceValidator('agent')> = AgentInterfaceValidator('agent').wait_for
 +      where AgentInterfaceValidator('agent') = interfaces.agent

self = <tests.ffe.test_flag_eval_evp.Test_FFE_EVP_Flagevaluation_Basic object at 0x7f767c236db0>

    def test_ffe_evp_flagevaluation_basic(self) -> None:
        assert self.r.status_code == 200, f"Flag evaluation failed: {self.r.text}"
...

tests.ffe.test_flag_eval_evp.Test_FFE_EVP_Flagevaluation_Burst_Aggregation.test_ffe_evp_flagevaluation_burst_aggregation[spring-boot] from system_tests_suite  

AssertionError: Timed out waiting for EVP flagevaluation event for flag evp-burst-aggregation-flag
assert False
 +  where False = <bound method ProxyBasedInterfaceValidator.wait_for of AgentInterfaceValidator('agent')>(<function wait_for_evp_flagevaluation_event.<locals>.<lambda> at 0x7f7639ea9bc0>, timeout=30)
 +    where <bound method ProxyBasedInterfaceValidator.wait_for of AgentInterfaceValidator('agent')> = AgentInterfaceValidator('agent').wait_for
 +      where AgentInterfaceValidator('agent') = interfaces.agent

self = <tests.ffe.test_flag_eval_evp.Test_FFE_EVP_Flagevaluation_Burst_Aggregation object at 0x7f767c236ae0>

    def test_ffe_evp_flagevaluation_burst_aggregation(self) -> None:
        for index, response in enumerate(self.responses):
...

View all 8 test failures

Testing the test | all-jobs-are-green     

ℹ️ Info

No other issues found (see more)

❄️ No new flaky tests detected

Useful? React with 👍 / 👎

_{This comment will be updated automatically if new data arrives.
🔗 Commit SHA: f8e5f5d | Docs | Datadog PR Page | Give us feedback!}

[datadog-system-tests-org]

⚠️ Warnings

🚦 2 Pipeline jobs failed

Testing the test | System Tests (java, dev) / End-to-end #1 / spring-boot 1     

Testing the test | all-jobs-are-green     

_{This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 923dc46 | Docs | Give us feedback!}