Skip to content

Attempt to fix flaky tests caused by modifying the same test apps. - #9929

Merged
kenzieschmoll merged 4 commits into
flutter:masterfrom
kenzieschmoll:test-flake
Jul 29, 2026
Merged

Attempt to fix flaky tests caused by modifying the same test apps.#9929
kenzieschmoll merged 4 commits into
flutter:masterfrom
kenzieschmoll:test-flake

Conversation

@kenzieschmoll

Copy link
Copy Markdown
Member

eval_on_dart_library.dart and inspector_integration_test.dart have been flaky. The hypothesis is that this was caused by multiple integration tests sharing the same fixture workspace.

@kenzieschmoll
kenzieschmoll requested review from a team and srawlins as code owners July 29, 2026 21:36

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request refactors inspector_integration_test.dart to leverage the built-in temporary directory support in FlutterTestEnvironment instead of manually copying and deleting the fixture directory. Feedback focuses on the change to the default value of useTempDirectory in FlutterTestEnvironment from false to true. This change would cause all tests using this environment to copy their fixtures, introducing unnecessary disk I/O. It is recommended to keep the default as false and explicitly enable useTempDirectory: true only in the integration test where it is needed.

Comment thread packages/devtools_app/test/test_infra/flutter_test_environment.dart Outdated
@kenzieschmoll
kenzieschmoll requested review from srawlins and removed request for srawlins July 29, 2026 21:37

@srawlins srawlins left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good idea.

@kenzieschmoll
kenzieschmoll merged commit 71c02db into flutter:master Jul 29, 2026
51 checks passed
@kenzieschmoll
kenzieschmoll deleted the test-flake branch July 29, 2026 23:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants