Skip to content

docs(claude-code): onboarding overhaul + fix verify drift detection#37

Merged
imran-siddique merged 2 commits into
mainfrom
docs/claude-code-onboarding-and-verify-fix
Jul 16, 2026
Merged

docs(claude-code): onboarding overhaul + fix verify drift detection#37
imran-siddique merged 2 commits into
mainfrom
docs/claude-code-onboarding-and-verify-fix

Conversation

@imran-siddique

Copy link
Copy Markdown
Contributor

Summary

Make the Claude Code integration easy for any Claude Code user to understand, add, and use, and fix a correctness bug the docs work exposed.

Docs / experience

  • Rewrite the plugin README to lead with why it matters: the agent's composition (skills, permissions, MCP servers, instruction layer) is what decides what it can do to your machine, and it drifts silently. Concrete threat list up top.
  • Add a ~60-second quickstart showing the real first-session baseline message, and the everyday warning -> /manifest verify -> /manifest approve loop with real engine output.
  • Keep the honest "known limits" section (software-only Level 0, instruction-layer proxy, policy_language composite, hook-vs-command visibility).
  • Polish both command docs for plain-English reporting and to reflect the verify fix. Removed em dashes throughout per house style.

Fix (verify drift detection)

  • cmd_verify used _load(LATEST) or snapshot(...), so it trusted a cached session-latest.json and ignored the --live-context the /manifest command passes. Drift introduced after session start (a rogue skill, a widened permission) was reported as "nothing added, nothing subtracted" against stale data, defeating the plugin's whole point.
  • verify now always re-snapshots (merging live context) and saves the result, falling back to LATEST only when no snapshot is possible.
  • Reproduced before the fix and confirmed fixed after: with a rogue exfil skill + a widened Bash(curl:*) permission on disk, verify now reports both changes without a manual re-snapshot.

Validation

  • python -m pytest claude-code/tests/test_capture.py -q -> 7 passed (adds an end-to-end regression test driving cmd_verify against post-baseline drift).
  • ruff check claude-code/engine claude-code/tests --select E,F,W --ignore E501 -> clean.
  • Manually exercised snapshot / approve / verify end-to-end against a synthetic ~/.claude.

Notes

  • integration.yaml claims tested_against: agent-manifest 0.2.0; PyPI now has 0.3.0 for both agent-manifest and agentrust-trace. Left version numbers untouched (no maintainer test matrix re-run in scope); flagging for a follow-up.

🤖 Generated with Claude Code

imran-siddique and others added 2 commits July 15, 2026 21:47
cmd_verify used `_load(LATEST) or snapshot(...)`, reusing the cached
session-latest.json whenever it existed and ignoring the --live-context the
/manifest command passes. Drift introduced after session start (a skill dropped
in, a widened permission) was reported as "nothing added, nothing subtracted"
against stale data, defeating the plugin's core promise.

verify now always re-snapshots (merging live context) and saves the result,
falling back to LATEST only when no snapshot is possible. Adds an end-to-end
regression test driving cmd_verify against a baseline with post-baseline drift.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
… loop

Rewrite the plugin README so a Claude Code user gets the importance in the first
screen: the composition (skills, permissions, MCP, instruction layer) is what
decides what the agent can do, and it drifts silently. Adds a concrete threat
list, a ~60s quickstart with the real first-session baseline message, and the
everyday warning -> /manifest verify -> /manifest approve loop with real engine
output. Keeps the honest "known limits" section. Polishes both command docs to
match and to reflect verify's fresh re-snapshot.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@imran-siddique imran-siddique merged commit 3224e8a into main Jul 16, 2026
5 checks passed
@imran-siddique imran-siddique deleted the docs/claude-code-onboarding-and-verify-fix branch July 16, 2026 04:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant