Skip to content

Align copilot-instructions.md descriptions with actual prompt behavior#168

Merged
Bryan-Roe merged 4 commits into
mainfrom
copilot/align-guide-with-prompt-behavior-again
May 9, 2026
Merged

Align copilot-instructions.md descriptions with actual prompt behavior#168
Bryan-Roe merged 4 commits into
mainfrom
copilot/align-guide-with-prompt-behavior-again

Conversation

Copilot AI commented Apr 30, 2026

Copy link
Copy Markdown
Contributor

The guide had two mismatches with the actual prompt files: agi-reasoning.agent.md was labeled "Chain-of-thought reasoning, self-reflection" — implying exposed CoT — while agi.prompt.md explicitly hides it. reason.prompt.md was labeled "Structured analysis", obscuring that it's the prompt that exposes chain-of-thought steps to the user.

Changes

  • agi-reasoning.agent.md table entry: Chain-of-thought reasoning, self-reflectionAutonomous multi-step reasoning with internal self-reflection (chain-of-thought is not exposed in output) — matches agi.prompt.md constraint: "Do not expose hidden chain-of-thought in responses"
  • reason.prompt.md prompt entry: Structured analysisExposed chain-of-thought analysis with structured reasoning steps and confidence scores — reflects that this is the correct prompt to use when visible reasoning steps are desired

No changes to the prompt files themselves; both were already correctly authored.

Summary by Sourcery

Align Copilot instructions with actual behavior of AGI reasoning and reasoning prompts, clarifying when chain-of-thought is internal vs exposed.

Documentation:

  • Update AGI reasoning agent description to state that chain-of-thought remains internal and not exposed in responses.
  • Clarify that the reasoning prompt exposes chain-of-thought with structured reasoning steps and confidence scores.

@sourcery-ai sourcery-ai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @Copilot! 👋

Your private repo does not have access to Sourcery.

Please upgrade to continue using Sourcery ✨

… behavior

Agent-Logs-Url: https://github.com/Bryan-Roe/Aria/sessions/2fd5a298-589f-4f1d-8a56-bf0ee365d28e

Co-authored-by: Bryan-Roe <74067792+Bryan-Roe@users.noreply.github.com>
Copilot AI changed the title [WIP] Fix inconsistency in agi.prompt.md documentation Align copilot-instructions.md descriptions with actual prompt behavior Apr 30, 2026
Copilot AI requested a review from Bryan-Roe April 30, 2026 14:42
@Bryan-Roe Bryan-Roe marked this pull request as ready for review May 6, 2026 04:41
Copilot AI review requested due to automatic review settings May 6, 2026 04:41
@sourcery-ai

sourcery-ai Bot commented May 6, 2026

Copy link
Copy Markdown
Contributor
Reviewer's guide (collapsed on small PRs)

Reviewer's Guide

Updates .github/copilot-instructions.md so that the documented behavior of the AGI reasoning agent and the reasoning prompt accurately reflects whether chain-of-thought is internal-only or exposed in responses, without changing any actual prompt behavior.

Flow diagram for choosing AGI reasoning agent vs reasoning prompt

flowchart TD
  Start([Start])
  Decide["Need visible reasoning steps in output?"]
  Hidden["Use agi.prompt.md and agi-reasoning.agent.md (chain-of-thought is internal, not exposed)"]
  Exposed["Use reason.prompt.md (exposed chain-of-thought with structured steps and confidence scores)"]
  End([End])

  Start --> Decide
  Decide -->|Yes| Exposed
  Decide -->|No| Hidden
  Hidden --> End
  Exposed --> End
Loading

File-Level Changes

Change Details Files
Clarified documentation of AGI reasoning agent and reasoning prompt to accurately describe internal vs exposed chain-of-thought behavior.
  • Updated the agi-reasoning.agent.md row in the agents table to describe autonomous multi-step reasoning with internal self-reflection and explicitly note that chain-of-thought is not exposed in output.
  • Updated the reason.prompt.md description in the prompts list to indicate that it provides exposed chain-of-thought analysis with structured reasoning steps and confidence scores.
.github/copilot-instructions.md

Assessment against linked issues

Issue Objective Addressed Explanation
#167 Align the copilot-instructions.md prompt/agent table descriptions with the actual behavior of the prompt files, specifically that agi.prompt.md keeps chain-of-thought internal and reason.prompt.md is the prompt to use when exposing reasoning steps.
#167 Update the later example text in copilot-instructions.md so it no longer tells readers to use agi.prompt.md for visible chain-of-thought reasoning, instead reflecting the actual behavior and correct prompt choice. The diff only changes the table descriptions for agi-reasoning.agent.md and reason.prompt.md. There is no modification to any later example text in copilot-instructions.md, so the guidance that instructs using agi.prompt for chain-of-thought reasoning appears unchanged.

Possibly linked issues


Tips and commands

Interacting with Sourcery

  • Trigger a new review: Comment @sourcery-ai review on the pull request.
  • Continue discussions: Reply directly to Sourcery's review comments.
  • Generate a GitHub issue from a review comment: Ask Sourcery to create an
    issue from a review comment by replying to it. You can also reply to a
    review comment with @sourcery-ai issue to create an issue from it.
  • Generate a pull request title: Write @sourcery-ai anywhere in the pull
    request title to generate a title at any time. You can also comment
    @sourcery-ai title on the pull request to (re-)generate the title at any time.
  • Generate a pull request summary: Write @sourcery-ai summary anywhere in
    the pull request body to generate a PR summary at any time exactly where you
    want it. You can also comment @sourcery-ai summary on the pull request to
    (re-)generate the summary at any time.
  • Generate reviewer's guide: Comment @sourcery-ai guide on the pull
    request to (re-)generate the reviewer's guide at any time.
  • Resolve all Sourcery comments: Comment @sourcery-ai resolve on the
    pull request to resolve all Sourcery comments. Useful if you've already
    addressed all the comments and don't want to see them anymore.
  • Dismiss all Sourcery reviews: Comment @sourcery-ai dismiss on the pull
    request to dismiss all existing Sourcery reviews. Especially useful if you
    want to start fresh with a new review - don't forget to comment
    @sourcery-ai review to trigger a new review!

Customizing Your Experience

Access your dashboard to:

  • Enable or disable review features such as the Sourcery-generated pull request
    summary, the reviewer's guide, and others.
  • Change the review language.
  • Add, remove or edit custom review instructions.
  • Adjust other review settings.

Getting Help

@sourcery-ai sourcery-ai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hey - I've reviewed your changes and they look great!


Sourcery is free for open source - if you like our reviews please consider sharing them ✨
Help me be more useful! Please click 👍 or 👎 on each comment and I'll use the feedback to improve your reviews.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates .github/copilot-instructions.md documentation so the “Agents” and “Prompts” tables better reflect the intended behavior of the AGI reasoning-related prompt/agent entries.

Changes:

  • Refines the agi-reasoning.agent.md table description to clarify chain-of-thought handling.
  • Updates the reason.prompt.md table description to indicate it is intended for visible/structured reasoning output (including confidence scoring).

Comment thread .github/copilot-instructions.md Outdated
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Signed-off-by: Bryan <74067792+Bryan-Roe@users.noreply.github.com>
Copilot AI review requested due to automatic review settings May 6, 2026 14:51

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 1 out of 1 changed files in this pull request and generated 1 comment.

Comment on lines 309 to 312
| `ai.agent.md` | Primary autonomous agent — task decomposition, multi-step execution |
| `my-agent.agent.md` | QAI specialist — quantum-AI/ML development |
| `agi-reasoning.agent.md` | Chain-of-thought reasoning, self-reflection |
| `agi-reasoning.agent.md` | Autonomous multi-step reasoning with internal self-reflection |
| `aria-character.agent.md` | Interactive character commands, animations |
Signed-off-by: Bryan <74067792+Bryan-Roe@users.noreply.github.com>
@Bryan-Roe Bryan-Roe merged commit 1bb6558 into main May 9, 2026
31 of 34 checks passed
@Bryan-Roe Bryan-Roe deleted the copilot/align-guide-with-prompt-behavior-again branch May 9, 2026 06:06
@github-actions

github-actions Bot commented May 9, 2026

Copy link
Copy Markdown
Contributor

⚠️ Deprecation Warning: The deny-licenses option is deprecated for possible removal in the next major release. For more information, see issue 997.

Dependency Review

✅ No vulnerabilities or license issues or OpenSSF Scorecard issues found.

Scanned Files

None

@github-actions

github-actions Bot commented May 9, 2026

Copy link
Copy Markdown
Contributor

🔴 Coverage — 982d375

Metric Value
Total coverage 59.7%
→ vs main 0.0%
Minimum threshold 60%

Updated on every push · 2026-05-09

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment