Add monitoring: track current file, provider health checks, latency tracking

[bashandbone]

Description

Three monitoring and observability improvements for the health service.

1. Track Current File in Indexer (health_service.py:160)

Add tracking of the currently processing file to Indexer for better observability.

Current State

• No visibility into current indexing progress
• Can't tell which file is being processed

Requirements

• Add current_file property to Indexer
• Update during indexing operations
• Expose in health check
• Thread-safe implementation

Benefits

• Better debugging of stuck indexing
• Progress visibility
• User feedback during long operations

2. Add Ping/Health Check to Vector Store Providers (health_service.py:228)

Implement health check methods for all vector store providers.

Current State

• No health check capability
• Can't verify provider connectivity
• Manual testing required

Requirements

• Add ping() or health_check() method
• Implement for all vector stores:
  • Qdrant
  • InMemory
  • Future providers

Checks Should Include

• Connection status
• Authentication validity
• Basic operation (lightweight query)
• Response time

3. Add Actual Latency Tracking to Providers (health_service.py:276)

Implement real latency measurement for provider operations.

Current State

• No latency tracking
• Performance issues hard to diagnose
• No baseline metrics

Requirements

• Track operation latencies:
  • Embedding generation
  • Vector search
  • Upsert operations
• Histogram metrics
• Percentiles (p50, p95, p99)
• Per-provider tracking

Benefits

• Performance monitoring
• SLA tracking
• Identify bottlenecks
• Alert on degradation

Source

• Files: health_service.py:160, health_service.py:228, health_service.py:276
• Branch: 003-our-aim-to

[github-actions]

Claude finished Adam Poulemanos (@bashandbone)'s task —— View job

---

Analyzing Issue #112: Monitoring Improvements

I found that the health_service.py exists in the 003-our-aim-to branch. I'm analyzing the code and planning the implementation.

Task List

• Read project constitution and CLAUDE.md for compliance
• Examine existing health_service.py and related code
• Implement Task 1: Track current file in Indexer
• Implement Task 2: Add ping/health check to vector store providers
• Implement Task 3: Add latency tracking to providers
• Run code quality checks
• Run tests
• Commit changes and provide PR link

Analysis Summary

The issue requests three monitoring improvements:

1. Track Current File (line 173): Add current_file property to Indexer class to show which file is being indexed
2. Provider Health Checks (line 241): Add ping() or health_check() methods to vector store providers
3. Latency Tracking (lines 243, 290): Replace placeholder latency values with real measurements

I'm now examining the full Indexer class structure to understand how to implement these features.

---