feat(bench): resource-monitor integration for benchmark orchestration (#159)#160
feat(bench): resource-monitor integration for benchmark orchestration (#159)#160
Conversation
facbd8f to
0d370e0
Compare
c3e7aa8 to
64febb6
Compare
Adds optional torc integration infrastructure: - torc feature flag in arco-bench with conditional compilation - runner module structure (torc/local backends) - example benchmark-workflow.kdl showing dependency chains - reqwest and torc-client as optional deps
64febb6 to
2299096
Compare
Code Review SummaryReviewed by Hermes Agent 🤖 This PR implements the foundation for benchmark orchestration with resource monitoring. All tests pass, code compiles cleanly, and the design is solid. 🔴 CriticalNone
|
Removing the arco-bench crate in preparation for simpler CLI-based benchmark approach using rmon resource monitoring. Deleted: - crates/arco-bench/Cargo.toml - crates/arco-bench/README.md - crates/arco-bench/src/ (main.rs, comparison.rs, reporting.rs, scenarios.rs, types.rs)
Adds a simple Python-based benchmark runner that wraps arco CLI commands with rmon resource monitoring. Added: - scripts/bench.py - CLI benchmark runner (~80 lines) - examples/stress-test/README.md - Stress test guide - Updated .github/workflows/benchmarks.yaml to use new runner Benefits: - Tests real user workflows (arco compile/solve) - Uses external rmon for accurate resource measurement - Integrates with github-action-benchmark
Summary
Implements foundation for torc-based benchmark orchestration (issue #159).
Changes
Next Steps (follow-up PRs)
API Documentation
Torc API spec researched and documented at `/tmp/torc-api-summary.md`:
Closes part of #159