backlog: Phase 6 infrastructure-dependent testing tasks (TASK-059/060/061/064/065/066) #1141
Description
Backlog: Phase 6 Infrastructure-Dependent Testing Tasks
The following Phase 6 tasks from Issue #1064 require running Docker infrastructure and cannot be automated in CI. They should be performed manually during deployment validation or as part of a dedicated infrastructure testing cycle.
Tasks
| Task | Description | Category |
|---|---|---|
| TASK-059 | Test standard runner with metrics under load (10 concurrent jobs) | Load testing |
| TASK-060 | Test Chrome runner with metrics under load (5 concurrent browser jobs) | Load testing |
| TASK-061 | Test Chrome-Go runner with metrics under load (5 concurrent Go + browser jobs) | Load testing |
| TASK-064 | Measure Prometheus storage growth over 7 days with 3 runners | Capacity planning |
| TASK-065 | Validate all Grafana dashboards display data correctly with real workloads | Dashboard validation |
| TASK-066 | Benchmark dashboard query performance (all panels < 2s with 7 days data) | Performance benchmarks |
Prerequisites
- Docker Engine running with all 3 runner types deployed
- Prometheus server scraping all runner endpoints
- Grafana connected to Prometheus with imported dashboards
- Real or simulated job workloads generating metrics
How to Execute
# Deploy all runner types
docker compose -f docker/docker-compose.production.yml up -d
docker compose -f docker/docker-compose.chrome.yml up -d
docker compose -f docker/docker-compose.chrome-go.yml up -d
# Verify metrics endpoints are live
curl http://localhost:9091/metrics
curl http://localhost:9092/metrics
curl http://localhost:9093/metrics
# Run existing tests in runtime mode
bash tests/integration/test-metrics-endpoint.sh
bash tests/integration/test-metrics-scaling.sh
# Manual load testing (TASK-059/060/061)
# Trigger concurrent workflow runs and monitor metrics
# Storage measurement (TASK-064)
# Monitor Prometheus TSDB size over 7 days
# Dashboard validation (TASK-065/066)
# Open Grafana dashboards and verify panel renderingRelated
- Issue [Feature] Phase 6: Testing & Validation #1064 (Phase 6: Testing & Validation)
- PR test: Phase 6 Prometheus monitoring test suite #1140 (CI-automatable test implementation)