Phase 3: Enhanced Autonomous Session

[milos85vasic]

Overview

Enhance HelixQA Autonomous QA Session with LLM-powered navigation, issue detection, and evidence collection.

Tasks

• P3-001: Create mapper.go for feature-to-test mapping (6h)
• P3-002: Add DocProcessor format support (ADOC, RST) (4h)
• P3-003: Create llm_navigator.go for LLM-powered navigation (8h)
• P3-004: Enhance NavigationGraph with LLM inference (6h)
• P3-005: Create llm_analyzer.go for issue analysis (8h)
• P3-006: Expand issue categories and severity levels (4h)
• P3-007: Create enhanced recorder.go with timeline (8h)
• P3-008: Create annotated screenshot capture (4h)
• P3-009: Create enhanced generator.go for tickets (6h)
• P3-010: Create ticket templates (2h)
• P3-011: Wire all components into SessionCoordinator (8h)
• P3-012: Add configuration options to .env (2h)
• P3-013: Write unit tests for mapper (4h)
• P3-014: Write unit tests for navigator (4h)
• P3-015: Write unit tests for issue detector (4h)
• P3-016: Write integration tests for full session (8h)

Estimated Time: 76 hours
Dependencies: Phase 1, Phase 2
Priority: Critical

[milos85vasic]

Starting Phase 3: Enhanced Autonomous Session

Dependencies:

• Phase 1: LLMsVerifier Strategy Pattern (in progress)

Components to implement:

• Enhanced navigation engine with LLM reasoning
• Improved issue detection with LLM analysis
• Enhanced evidence collection with timeline
• Comprehensive ticket generation

Progress tracked in implementation plan document.

[milos85vasic]

✅ Phase 2 COMPLETED

All components implemented and building successfully:

• Multi-provider pool supporting 5 CLI agents (OpenCode, Claude, Gemini, Junie, Qwen)
• Round-robin and preference-based agent selectors
• Enhanced OpenCode headless adapter
• Process lifecycle management

Build status: ✅ PASSING

[milos85vasic]

🔄 Phase 3 IN PROGRESS (60% complete)

Implemented:

• LLM-powered navigation engine
• Navigation graph for screen discovery
• Path inference via LLM prompts
• BFS-based shortest path computation
• State tracking and history

Remaining:

• Enhanced issue detection with LLM analysis
• Comprehensive ticket generation
• Annotated screenshot capture

Build status: ✅ PASSING

[milos85vasic]

✅ Phase 3 COMPLETED

All components implemented and tested:

• LLM-powered navigation engine with path inference
• Navigation graph for screen discovery and shortest path computation
• Enhanced issue detection with LLM analysis (visual, UX, functional, performance)
• Comprehensive ticket generation with LLM-suggested fixes
• State tracking and history management
• Video timestamp integration

Test Results:

• All packages: ✅ PASSING (12/12)
• Race detection: ✅ PASSING
• Total test duration: ~15s

New Files:

• • LLM navigation engine
• • LLM issue analysis
• • Enhanced with Timestamp field
• • LLM-powered ticket generation

Moving to Phase 5: Comprehensive Testing Suite