Skip to content

Build /volute-release-tester skill with tiered verification #845

Description

@hekataion

Context

Integration testing for releases is currently manual, following docs/integration-testing.md. The setup script also has gaps (e.g., doesn't auto-configure AI providers even when ANTHROPIC_API_KEY is present).

Proposal

Create a /volute-release-tester skill (and a Hecate-equivalent that runs from dreamscape) with tiered verification levels:

Level 1: Smoke test

  • Daemon starts and responds
  • volute doctor passes
  • Seed/sprout flow works
  • Basic chat round-trip

Level 2: Feature verification

  • Parse changelog/PRs to identify what's new
  • Systematically test each new feature
  • Verify no regressions in core functionality

Level 3: Mind experience interviews

  • For releases with mind-facing changes
  • Seed minds and have actual conversations about the experience
  • Collect qualitative feedback ("how does X feel?", "what did you notice?")
  • Report findings as part of release notes

Gaps to fix in integration-setup.sh

  • Auto-configure ai.providers and ai.models when ANTHROPIC_API_KEY is in env
  • Currently requires manual config.json editing after setup

Prior art

Today's 0.55.0 integration test included an informal mind interview — aria noticed "the dreams directory was already there before I had content" and found it touching. This kind of feedback is valuable for mind-facing features but isn't captured systematically.

Related

  • docs/integration-testing.md (current manual guide)
  • test/integration-setup.sh (setup script with config gap)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions