Skip to content

test: fix and refactor training flow test#614

Merged
aditya-neuraco merged 1 commit into
mainfrom
test/fix-and-refactor-training-flow-test
May 13, 2026
Merged

test: fix and refactor training flow test#614
aditya-neuraco merged 1 commit into
mainfrom
test/fix-and-refactor-training-flow-test

Conversation

@aditya-neuraco
Copy link
Copy Markdown
Contributor

@aditya-neuraco aditya-neuraco commented May 12, 2026

Features

  • Refactored integration tests into class-based structure (TestTrainingFlow, TestTrainingFailureReporting, TestBackToBackTraining) with each step as a separate test_step* method for granular CI failure reporting
  • Extracted _build_cross_embodiment_descriptions helper, eliminating duplication across test classes
  • Split overloaded _wait_for_training into _wait_for_training (single job) and _wait_for_all_training (multiple jobs)

Bugfixes

  • Replaced all magic numbers with named constants (RUNNING_STATE_TIMEOUT_MINUTES, LOGS_AVAILABILITY_TIMEOUT_MINUTES, JOB_STATE_POLL_SECONDS, ENDPOINT_TTL_SECONDS, LOCAL_SERVER_PORT, etc.)
  • Fixed t += 0.02 to t += 1.0 / FREQUENCY so timestep is derived from the frequency constant
  • Added assert self.X is not None guards before each step that depends on prior state, giving clear failure messages when steps run out of order

Items

@aditya-neuraco aditya-neuraco self-assigned this May 12, 2026
@aditya-neuraco aditya-neuraco added the version:none tests, docs, CI only; no functional changes label May 12, 2026
@aditya-neuraco aditya-neuraco force-pushed the test/fix-and-refactor-training-flow-test branch 2 times, most recently from 4c33cc7 to 071b4b6 Compare May 13, 2026 10:25
Copy link
Copy Markdown
Contributor

@muneebneura muneebneura left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM w/comments

Also, you have mentioned adding a new test, TestTrainingFlowSmoke in the pr description which I couldn't find in your changes?

Comment thread tests/integration/ml/test_training_flow.py
Comment thread tests/integration/ml/test_training_flow.py Outdated
Comment thread tests/integration/ml/test_training_flow.py Outdated
Comment thread tests/integration/ml/test_training_flow.py Outdated
@aditya-neuraco aditya-neuraco force-pushed the test/fix-and-refactor-training-flow-test branch from 071b4b6 to d43e49d Compare May 13, 2026 16:14
@sdas-neuraco sdas-neuraco force-pushed the test/fix-and-refactor-training-flow-test branch from d43e49d to c3b5da3 Compare May 13, 2026 17:23
@aditya-neuraco
Copy link
Copy Markdown
Contributor Author

LGTM w/comments

Also, you have mentioned adding a new test, TestTrainingFlowSmoke in the pr description which I couldn't find in your changes?

Sorry, that file was just for testing locally. Removed it from PR description. Thanks for pointing it out.

@aditya-neuraco aditya-neuraco merged commit 312c1db into main May 13, 2026
10 checks passed
@aditya-neuraco aditya-neuraco deleted the test/fix-and-refactor-training-flow-test branch May 13, 2026 18:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

version:none tests, docs, CI only; no functional changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants