Skip to content

iterate skill: add review thread reply and resolve guidance#206

Merged
xingyaoww merged 2 commits into
mainfrom
iterate-reply-and-resolve-threads
Apr 23, 2026
Merged

iterate skill: add review thread reply and resolve guidance#206
xingyaoww merged 2 commits into
mainfrom
iterate-reply-and-resolve-threads

Conversation

@xingyaoww
Copy link
Copy Markdown
Member

Summary

The /iterate skill previously told the agent to fix code and push when addressing review feedback, but never mentioned replying to individual review threads or resolving them. This left threads dangling in the GitHub UI even after the underlying code was fixed.

Changes

Updated review comment workflow (steps)

  • Actionable comments: added "reply to thread" and "resolve thread" as explicit steps before commit/push
  • Non-actionable comments: now requires a brief reply explaining why before resolving, instead of silently continuing

New subsection: "Replying to and resolving review threads"

  • Concrete gh CLI commands for replying (REST API with -F for numeric in_reply_to)
  • Concrete gh CLI command for resolving threads (GraphQL resolveReviewThread mutation)
  • GraphQL query for discovering all unresolved threads and their IDs
  • Rules: reply to every thread (even nits), resolve addressed threads, verify zero unresolved before marking PR ready

Updated "When done" section

  • Added step to verify all review threads are resolved before gh pr ready

Updated final summary output

  • Added "Review threads resolved (count)" to the list of items in the final summary

Motivation

This was discovered during a real iteration on PR #205, where all review feedback was addressed in code but none of the 10 review threads were replied to or resolved. The reviewer experience was poor — they had to manually check each thread to see if it was addressed. The iterate skill should close the loop properly.


This PR was created by an AI assistant (OpenHands) on behalf of the user.

The iterate skill previously told the agent to fix code and push when
addressing review feedback, but never mentioned replying to individual
review threads or resolving them. This left threads dangling in the
GitHub UI even after the code was fixed.

Changes:
- Updated the actionable/non-actionable comment workflows to include
  reply and resolve steps
- Added a new 'Replying to and resolving review threads' subsection
  with concrete gh CLI commands (REST for reply, GraphQL for resolve)
- Added a GraphQL query for discovering unresolved threads and their IDs
- Added rules: reply to every thread, resolve addressed threads, verify
  zero unresolved threads before marking PR ready
- Updated 'When done' section to require thread verification
- Added 'Review threads resolved (count)' to final summary output

Co-authored-by: openhands <openhands@all-hands.dev>
Copy link
Copy Markdown
Contributor

@all-hands-bot all-hands-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Solid improvement addressing a real problem. The guidance for replying to and resolving review threads fills an important gap. One workflow ordering concern to address.

Comment thread skills/iterate/SKILL.md Outdated
Comment thread skills/iterate/SKILL.md
Comment thread skills/iterate/SKILL.md
Comment thread skills/iterate/SKILL.md
@xingyaoww
Copy link
Copy Markdown
Member Author

@OpenHands /iterate until reviewer bot approves.

Also send the new PR to ReviewBot. Ask it to not comment anything about acceptable; we don't want these green comments because they are just noise.

@openhands-ai
Copy link
Copy Markdown

openhands-ai Bot commented Apr 23, 2026

I'm on it! xingyaoww can track my progress at all-hands.dev

Commit and push before replying to review threads, so the reply can
reference the actual commit SHA (e.g. 'Fixed in abc1234').

Co-authored-by: openhands <openhands@all-hands.dev>
Copy link
Copy Markdown
Member Author

Addressed the workflow ordering feedback in c72919c. All review threads resolved. Ready for another review.

Review instruction: Please do not post 🟢 Acceptable or 🟢 Nit comments — they are noise. Only comment on items that need action (🔴 Critical, 🟠 Important, 🟡 Suggestion).

@xingyaoww xingyaoww requested a review from all-hands-bot April 23, 2026 17:26
Copy link
Copy Markdown
Contributor

@all-hands-bot all-hands-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Solid improvement that addresses a real usability gap. The guidance for replying to and resolving review threads fills an important operational gap in the iterate workflow.

All previous concerns (particularly the workflow ordering inconsistency) have been resolved. The technical commands are correct and the integration with the existing loop structure is clean.

[RISK ASSESSMENT]
🟢 LOW - Documentation-only change that improves agent behavior without breaking existing functionality. Commands are technically correct and workflow is pragmatic.

@xingyaoww xingyaoww merged commit e42bffe into main Apr 23, 2026
4 checks passed
@openhands-ai
Copy link
Copy Markdown

openhands-ai Bot commented Apr 23, 2026

Summary of Work Done

Request Checklist

  1. /iterate until reviewer bot approves — Addressed the bot's 🟡 Suggestion (workflow ordering inconsistency), committed, pushed, re-requested review, and polled until all-hands-bot approved.
  2. Send the new PR to ReviewBot — Re-requested all-hands-bot as a reviewer, which triggered the PR Review workflow on the new SHA.
  3. Ask it to not comment anything about acceptable (no green comments) — Left a PR comment with explicit review instruction: "Please do not post 🟢 Acceptable or 🟢 Nit comments — they are noise." The bot complied — zero new inline comments in the second review round.

Changes Made

  • 1 commit (c72919c): Reordered the "actionable comment" workflow steps in skills/iterate/SKILL.md from "fix → reply → resolve → commit → push" to "fix → commit → push → reply (with SHA) → resolve". This was the only code change, directly addressing the bot's feedback.
  • 4 review threads replied to and resolved via the GitHub API.

Conciseness

The changes are minimal and focused — a single 4-line swap in the SKILL.md file. No extraneous changes were made.

Final State

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants