Skip to content

[Feature]: Integrate BAML for structured output in watchdog #88

Description

@HyunggyuJang

Problem Statement

Currently, open router is used and output parsing is relied solely on prompting, which is fragile.

Proposed Solution

Use BAML by wrapping openrouter endpoint: https://docs.boundaryml.com/ref/llm-client-providers/openai-generic

It would be better to allow to replace the LLM endpoint so that the user can use local LLMs like ollama.

FYI, from claude agent sdk side, you can use structured output feature for the same purpose: https://platform.claude.com/docs/en/agent-sdk/structured-outputs

Alternatives Considered

No response

Feature Area

Policy engine / evaluation

Related Harness

None

Use Case

No response

Additional Context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requesttriageIssues that need to be triaged

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions