Skip to content

Observability dashboard with org-level metrics #9

Description

@haasonsaas

Problem

Room records durable audit events (append-only, SQLite) but the admin dashboard is currently a minimal token-based UI. Security and engineering teams need visibility into how coding agents are being used and what Room is enforcing across the organization.

Proposal

Expand the dashboard to surface:

  • Guardrail invocations over time (allow / block / indeterminate breakdown)
  • Active agents and workspaces — which agents are connected, how often they call Room
  • Policy violations — blocked actions grouped by signal type, ruleset version, workspace
  • MCP tool usage — call counts for room_get_rules, room_analyze_plan, room_check_diff
  • Ruleset version history — what changed when, who published

These metrics already exist in the audit event log; the work is aggregation and presentation.

Why

Security teams are the primary buyers of guardrail tooling, and audit/visibility is a core requirement — both for incident response and for compliance evidence. The data is already being collected; it needs to be queryable.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions