Skip to content

[C++] Nightly Integration Testing Report #1710

@github-actions

Description

@github-actions

Note: This report excludes Firestore. Please also check the report for Firestore.


Testing History (last 7 days)

Date Build vs Source Repo Test vs Source Repo SDK Packaging Build vs SDK Package Test vs SDK Package Notes
2026‑02‑27 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 A test error in Auth on Windows, and test flakes in Auth on Android emulator and Storage on Android.
2026‑02‑28 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test errors in Auth on Windows and Linux, and a test flake in Messaging on Android.
2026‑03‑01 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ❌ Failure
 A test flake in App Check on Android.
2026‑03‑02 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ❌ Failure
 A test error in Analytics on Windows, and test flakes in Storage on Android emulator, Messaging on Android, and Auth on Android.
2026‑03‑03 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ❌ Failure
 A test error in Auth on Windows and a test flake in Auth on Android.
2026‑03‑04 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass
 A test error in Auth on Android emulator and a test flake in Auth on Android emulator.
2026‑03‑05 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ❌ Failure
 Test errors in Auth on Linux and Windows and Analytics on Windows.
View extended history (last 30 days)

Testing History (last 30 days)

Date Build vs Source Repo Test vs Source Repo SDK Packaging Build vs SDK Package Test vs SDK Package Notes
2026‑02‑04 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass
 Test flakes in Auth on Android and Remote Config on Android emulator.
2026‑02‑05 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass (flaky)
 A test flake in Auth on Android emulator.
2026‑02‑06 ✅ Pass ❌ Failure ❌ Failure ❌ Missing ❌ Missing
 Test errors in Auth on Linux and Windows and Storage on Linux.
2026‑02‑07 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ❌ Failure
 A test error in Auth on Windows.
2026‑02‑08 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ❌ Failure
 Test errors in Auth on Linux and Windows, and test flakes in Installations on Android emulator and Auth on Android.
2026‑02‑09 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 A test error in Analytics on Windows and a test flake in Auth on Android.
2026‑02‑10 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ❌ Failure
 A test error in Remote Config on Windows, and test flakes in Storage on Android emulator and Auth on Android.
2026‑02‑11 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ❌ Failure
 A test error in Analytics on Windows and a test flake in Auth on Android emulator.
2026‑02‑12 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 A test error in Auth on Android emulator and a test flake in Auth on Android.
2026‑02‑13 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ❌ Failure
 Test errors in Auth on Linux and Windows.
2026‑02‑14 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ❌ Failure
 A test flake in Auth on Android emulator.
2026‑02‑15 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass
 A test flake in Auth on Android emulator.
2026‑02‑16 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ❌ Failure
 Test errors in Auth on Linux and Windows, and a test flake in Messaging on Android.
2026‑02‑17 ✅ Pass ✅ Pass ✅ Pass ✅ Pass ✅ Pass
2026‑02‑18 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ✅ Pass (flaky)
 A test flake in Auth on Android.
2026‑02‑19 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test errors in Auth on Linux and Android, and a test flake in Auth on Android.
2026‑02‑20 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ❌ Failure
 A test flake in Auth on Android emulator.
2026‑02‑21 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test errors in Auth on MacOS, Windows, and Linux.
2026‑02‑22 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test errors in Auth on Linux and Windows, and test flakes in Storage on Android emulator and Installations on Android emulator.
2026‑02‑23 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ❌ Failure
 A test flake in Auth on Android.
2026‑02‑24 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ❌ Failure
 Test errors in Auth on Linux and Windows.
2026‑02‑25 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ❌ Failure
 A test flake in Auth on Android.
2026‑02‑26 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ❌ Failure
 A test flake in Remote Config on Android emulator.
2026‑02‑27 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 A test error in Auth on Windows, and test flakes in Auth on Android emulator and Storage on Android.
2026‑02‑28 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass (flaky)
 Test errors in Auth on Windows and Linux, and a test flake in Messaging on Android.
2026‑03‑01 ✅ Pass ✅ Pass (flaky) ✅ Pass ✅ Pass ❌ Failure
 A test flake in App Check on Android.
2026‑03‑02 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ❌ Failure
 A test error in Analytics on Windows, and test flakes in Storage on Android emulator, Messaging on Android, and Auth on Android.
2026‑03‑03 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ❌ Failure
 A test error in Auth on Windows and a test flake in Auth on Android.
2026‑03‑04 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ✅ Pass
 A test error in Auth on Android emulator and a test flake in Auth on Android emulator.
2026‑03‑05 ✅ Pass ❌ Failure ✅ Pass ✅ Pass ❌ Failure
 Test errors in Auth on Linux and Windows and Analytics on Windows.
Top 10 flakes/failures (last 30 days)
# Latest Product Platform Test Info
18 1 day ago Auth Android FirebaseAuthTest.TestSignInWithBadEmailFails (flaky)
   Logs: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18
11 Today Auth Windows FirebaseAuthTest.TestSignInWithBadEmailFails (failure)
   Logs: 1 2 3 4 5 6 7 8 9 10 11
10 Today Auth Linux FirebaseAuthTest.TestSignInWithBadEmailFails (failure)
   Logs: 1 2 3 4 5 6 7 8 9 10
4 3 days ago Storage Android Crash or timeout (flaky)
   Logs: 1 2 3 4
4 Today Analytics Windows FirebaseAnalyticsTest.TestDesktopInitialization (failure)
   Logs: 1 2 3 4
4 Today Analytics Windows FirebaseAnalyticsTest.TestSetLogCallback (failure)
   Logs: 1 2 3 4
3 1 day ago Auth Android FirebaseAuthTest.TestSignInWithBadEmailFails (failure)
   Logs: 1 2 3
2 5 days ago Messaging Android FirebaseMessagingTest.TestSendMessageToTopic (flaky)
   Logs: 1 2
2 7 days ago Remote Config Android FirebaseRemoteConfigTest.TestAddOnConfigUpdateListener (flaky)
   Logs: 1 2
1 2 days ago Auth Windows FirebaseAuthTest.TestLinkAnonymousUserWithBadCredential (failure)
   Logs: 1
📄
2026-02-27			Pass	Failure	Pass	Pass	Pass (flaky)	A test error in Auth on Windows, and test flakes in Auth on Android emulator and Storage on Android.
2026-02-28			Pass	Failure	Pass	Pass	Pass (flaky)	Test errors in Auth on Windows and Linux, and a test flake in Messaging on Android.
2026-03-01			Pass	Pass (flaky)	Pass	Pass	Failure	A test flake in App Check on Android.
2026-03-02			Pass	Failure	Pass	Pass	Failure	A test error in Analytics on Windows, and test flakes in Storage on Android emulator, Messaging on Android, and Auth on Android.
2026-03-03			Pass	Failure	Pass	Pass	Failure	A test error in Auth on Windows and a test flake in Auth on Android.
2026-03-04			Pass	Failure	Pass	Pass	Pass	A test error in Auth on Android emulator and a test flake in Auth on Android emulator.
2026-03-05			Pass	Failure	Pass	Pass	Failure	Test errors in Auth on Linux and Windows and Analytics on Windows.


[build against repo] Integration test with FLAKINESS (succeeded after retry)

Requested by @DellaBitta on commit 5f348b8
Last updated: Thu Mar 5 04:07 PST 2026
View integration test log & download artifacts

Failures Configs
app_check [TEST] [FLAKINESS] [iOS] [macos] [1/2 ios_device: ios_target]
(1 failed tests)  FirebaseAppCheckTest.TestSignIn

Add flaky tests to go/fpl-cpp-flake-tracker


[build against SDK] Integration test with FLAKINESS (succeeded after retry)

Requested by @firebase-workflow-trigger[bot] on commit 5f348b8
Last updated: Thu Mar 5 05:38 PST 2026
View integration test log & download artifacts

Failures Configs
app_check [TEST] [FLAKINESS] [Android] [1/3 os: ubuntu] [1/4 android_device: android_latest]
(9 failed tests)  FirebaseAppCheckTest.TestAddTokenChangedListener
  FirebaseAppCheckTest.TestDatabaseCreateWorkingPath
  FirebaseAppCheckTest.TestDatabaseRunTransaction
  FirebaseAppCheckTest.TestDatabaseSetAndGet
  FirebaseAppCheckTest.TestGetLimitedUseAppCheckToken
  FirebaseAppCheckTest.TestGetTokenForcingRefresh
  FirebaseAppCheckTest.TestGetTokenLastResult
  FirebaseAppCheckTest.TestRemoveTokenChangedListener
  FirebaseAppCheckTest.TestStorageReadFile
auth [TEST] [FLAKINESS] [Android] [1/3 os: ubuntu] [1/4 android_device: android_target]
(1 failed tests)  FirebaseAuthTest.TestSignInWithBadEmailFails
installations [TEST] [FLAKINESS] [Android] [1/3 os: windows] [1/4 android_device: android_target]
(1 failed tests)  FirebaseInstallationsTest.TestCanGetToken

Add flaky tests to go/fpl-cpp-flake-tracker

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions