You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Analysis Date: February 15, 2026 Repository: github/gh-aw Scope: 213 total workflows, 74 using Copilot engine (34.7%) Workflow Run:§22043143290
📊 Executive Summary
Research Topic: Copilot CLI Optimization Opportunities
Key Findings:
Underutilized Advanced Features - Custom agent files exist but aren't referenced via engine.agent field; no workflows use custom engine.args
Zero Plugin Adoption - Despite full plugin support, no workflows install or use plugins
Limited GitHub Toolsets - Most workflows use generic [default] instead of specific toolsets like [repos, issues]
Strong Auto-Configuration - Compiler successfully auto-configures most Copilot features (--share, --add-dir, --disable-builtin-mcps)
Low Safe-Inputs Adoption - Feature exists but rarely used
Primary Recommendation: Create workflow templates and documentation for underutilized features (engine.agent, plugins, GitHub toolsets, safe-inputs) to improve developer experience and unlock Copilot's full potential.
The analysis reveals a healthy foundation with room for optimization. Most workflows rely on smart defaults, which works well, but advanced features remain undiscovered. Targeted documentation and examples could significantly improve adoption.
Critical Findings
🔴 High Priority Issues
1. Plugin Support Completely Unused
Issue: 0 workflows use plugins despite full Copilot support
Impact: Missing opportunities for specialized tools (language servers, linters, formatters)
Evidence:supportsPlugins: true in copilot_engine.go but zero plugins: declarations in workflows
Action: Create plugin examples and documentation
2. Custom Agent Files Not Leveraged
Issue: 9 custom agent files exist in .github/agents/ but no workflows use engine.agent field to reference them
Impact: Specialized agent instructions created but not utilized for their intended purpose
Files Found:developer.instructions.md, technical-doc-writer.agent.md, grumpy-reviewer.agent.md, etc.
Action: Document engine.agent field usage and create migration guide
🟡 Medium Priority Opportunities
3. GitHub Toolsets Generic Usage
Issue: Most workflows use toolsets: [default] instead of specific toolsets
Impact: Broader permissions than needed, potential performance overhead
Better Practice: Use specific toolsets like [repos, issues] for focused permissions
Action: Audit workflows and recommend specific toolsets
4. Safe-Inputs Low Adoption
Issue: Safe-inputs feature rarely used despite availability
Impact: Missing opportunity for secure secret injection
Usage: Very few workflows in 213 total
Action: Create safe-inputs examples and use cases
1️⃣ Current State Analysis
View Copilot CLI Capabilities Inventory
Copilot CLI Capabilities Inventory
Version Information:
Current default version: 0.0.410
Default detection model: gpt-5.1-codex-mini
MCP Gateway version: v0.1.4
Available CLI Flags:
--share - Conversation tracking (auto-added)
--add-dir - Directory access control (auto-configured)
---
name: Enhanced Code Reviewengine: copilotplugins:
- typescript-language-server
- gopls # Go language server
- ruff # Python lintertools:
edit: truebash: truegithub:
toolsets: [pull_requests]
---
Review this pull request with full language intelligence.
Opportunity 2: Leverage Custom Agent Files via engine.agent
What: 9 custom agent files exist in .github/agents/ but no workflows use the engine.agent field to reference them.
Why It Matters:
Agent files provide specialized instructions and behaviors
Currently used via imports: but not via native Copilot --agent flag
Native agent support may provide better integration and performance
Where: Workflows that could benefit from specialized agents:
grumpy-reviewer.md could use .github/agents/grumpy-reviewer.agent.md
Technical documentation workflows could use technical-doc-writer.agent.md
Development workflows could use developer.instructions.md
Reduce to 15 min: Smoke tests, simple checks, formatting tasks
Keep 30 min: Standard agent tasks (current default is reasonable)
Increase to 45-60 min: Large codebase analysis, comprehensive reviews, multiple file changes
Opportunity 7: Adopt Repo-Memory for Cross-Run State
What: Repo-memory tool has moderate adoption but could benefit more workflows.
Why It Matters:
Persist data across workflow runs
Track trends and history
Enable stateful agents (learning from previous runs)
Where: Workflows that would benefit from memory:
Quality metrics tracking
Performance analysis over time
Issue triage (remember previous decisions)
Weekly/daily summary workflows
Current Usage: Moderate (some workflows use it)
How to Implement:
tools:
repo-memory:
branch-name: memory/my-workflowfile-glob: "**/*.json"max-file-size: 102400# 100KB# Then in workflow:# - Read previous state from /tmp/gh-aw/repo-memory/default/# - Process and update# - Write back to repo-memory
Opportunity 8: Leverage Cache-Memory for Within-Run State
What: Cache-memory provides within-run state management for complex workflows.
Why It Matters:
Share data between workflow steps
Enable multi-phase processing
Store intermediate results
Where: Workflows with multiple processing phases:
Investigation + remediation
Analysis + report generation
Data collection + visualization
Current Usage: Moderate adoption
How to Implement:
tools:
cache-memory: true# Workflow can write to /tmp/gh-aw/cache-memory/# Data persists across detection/agent phases
View Low Priority Opportunities
🟢 Low Priority
Opportunity 9: Use Model Overrides Strategically
What: Model overrides exist but are limited to cost-saving models (gpt-5.1-codex-mini).
Why It Matters:
Cost optimization for simple tasks
Performance tuning for specific workload types
Testing different model capabilities
Where:
Use cost-effective models for simple tasks
Use advanced models for complex reasoning
Current usage: Mostly defaults or gpt-5.1-codex-mini
How to Implement:
engine:
id: copilotmodel: gpt-5.1-codex-mini # For simple, cost-sensitive tasks# Or use environment variable for flexible overrides:# GH_AW_MODEL_AGENT_COPILOT=gpt-5 (set at repo/org level)
Opportunity 10: Pin Versions for Critical Workflows
What: Most workflows use default "latest" version, which auto-updates.
Why It Matters:
Stability for critical workflows
Controlled upgrades and testing
Reproducible builds
Where: Production-critical workflows that need stability:
Release workflows
Security scanning
Compliance checking
How to Implement:
engine:
id: copilotversion: "0.0.410"# Pinned version
Increase timeout to 45-60 minutes for thorough analysis
Consider cache-memory for multi-phase research
Expected Benefits: Historical tracking, sufficient time, intermediate state management
5️⃣ Trends & Insights
View Historical Trends
First Analysis Notice:
This is the first comprehensive Copilot CLI deep research analysis for this repository. Future runs will compare against this baseline to track:
Feature adoption rates - Which recommendations are being implemented
New features - What capabilities Copilot CLI adds over time
Usage patterns - How workflow configurations evolve
Best practices - Emerging patterns and anti-patterns
Baseline Established (February 2026):
74 Copilot workflows (34.7% adoption)
Strong auto-configuration foundation
Low advanced feature adoption
High safe-outputs usage
Zero plugin adoption
Rare custom engine configuration
Next Analysis Recommendations:
Run quarterly to track trends
Monitor plugin adoption after documentation is created
Track engine.agent field usage after migration guide
Measure GitHub toolsets specificity improvements
6️⃣ Best Practice Guidelines
Based on this research, here are recommended best practices for Copilot workflows:
1. Use Specific GitHub Toolsets
Instead of toolsets: [default], use specific toolsets like [issues], [pull_requests], [repos], or [actions] to reduce permission scope and improve clarity.
tools:
github:
toolsets: [issues, pull_requests] # Specific, not default
2. Leverage Custom Agent Files
Reference specialized agents using engine.agent field to utilize the agent files in .github/agents/:
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
-
🔍 Copilot CLI Deep Research Report
Analysis Date: February 15, 2026
Repository: github/gh-aw
Scope: 213 total workflows, 74 using Copilot engine (34.7%)
Workflow Run: §22043143290
📊 Executive Summary
Research Topic: Copilot CLI Optimization Opportunities
Key Findings:
engine.agentfield; no workflows use customengine.args[default]instead of specific toolsets like[repos, issues]--share,--add-dir,--disable-builtin-mcps)Primary Recommendation: Create workflow templates and documentation for underutilized features (engine.agent, plugins, GitHub toolsets, safe-inputs) to improve developer experience and unlock Copilot's full potential.
The analysis reveals a healthy foundation with room for optimization. Most workflows rely on smart defaults, which works well, but advanced features remain undiscovered. Targeted documentation and examples could significantly improve adoption.
Critical Findings
🔴 High Priority Issues
1. Plugin Support Completely Unused
supportsPlugins: truein copilot_engine.go but zeroplugins:declarations in workflows2. Custom Agent Files Not Leveraged
.github/agents/but no workflows useengine.agentfield to reference themdeveloper.instructions.md,technical-doc-writer.agent.md,grumpy-reviewer.agent.md, etc.engine.agentfield usage and create migration guide🟡 Medium Priority Opportunities
3. GitHub Toolsets Generic Usage
toolsets: [default]instead of specific toolsets[repos, issues]for focused permissions4. Safe-Inputs Low Adoption
1️⃣ Current State Analysis
View Copilot CLI Capabilities Inventory
Copilot CLI Capabilities Inventory
Version Information:
0.0.410gpt-5.1-codex-miniv0.1.4Available CLI Flags:
--share- Conversation tracking (auto-added)--add-dir- Directory access control (auto-configured)--agent- Custom agent identifier--model- Model override--disable-builtin-mcps- Disable built-in MCP servers (auto-added)--allow-all-paths- Full filesystem write access (auto-added with edit tool)--allow-all-tools- Allow all tool permissions (used with bash wildcard)--log-level- Logging verbosity (auto-set to "all")--log-dir- Log output directory (auto-configured)Engine Configuration Options:
engine.id- Engine identifier ("copilot")engine.version- Version pinning (defaults to latest)engine.model- Model override (e.g., "gpt-5.1-codex-mini")engine.args- Custom CLI arguments arrayengine.agent- Custom agent file identifierengine.env- Custom environment variablesengine.command- Command override (default: "copilot")Supported Capabilities:
View Usage Statistics
Usage Statistics
Workflow Distribution:
Tool Adoption:
Configuration Patterns:
Timeout Distribution:
2️⃣ Feature Usage Matrix
3️⃣ Missed Opportunities
View High Priority Opportunities
🔴 High Priority
Opportunity 1: Enable Plugin Support
What: Copilot CLI supports plugin installation for specialized tools (language servers, linters, analyzers), but zero workflows use this feature.
Why It Matters: Plugins can significantly enhance agent capabilities with:
Where: Any workflow doing code analysis, refactoring, or generation could benefit. Examples:
archie.md(Go architecture analysis)jsweep.md(JavaScript cleanup)python-data-charts.md(Python data analysis)How to Implement:
Example Workflow Enhancement:
Opportunity 2: Leverage Custom Agent Files via engine.agent
What: 9 custom agent files exist in
.github/agents/but no workflows use theengine.agentfield to reference them.Why It Matters:
imports:but not via native Copilot--agentflagWhere: Workflows that could benefit from specialized agents:
grumpy-reviewer.mdcould use.github/agents/grumpy-reviewer.agent.mdtechnical-doc-writer.agent.mddeveloper.instructions.mdFiles Available:
developer.instructions.mdtechnical-doc-writer.agent.mdgrumpy-reviewer.agent.mdagentic-workflows.agent.mdci-cleaner.agent.mdinteractive-agent-designer.agent.mdw3c-specification-writer.agent.mdcreate-safe-output-type.agent.mdcustom-engine-implementation.agent.mdHow to Implement:
Migration Example:
Opportunity 3: Use Specific GitHub Toolsets
What: Most workflows use generic
toolsets: [default]instead of specific toolsets like[repos, issues, pull_requests].Why It Matters:
Where: Any workflow using GitHub tool. Examples:
toolsets: [issues]toolsets: [pull_requests]toolsets: [repos]toolsets: [actions]Available Toolsets:
default- All common operationsrepos- Repository operationsissues- Issue managementpull_requests- Pull request operationsactions- Workflow and action operationsHow to Implement:
Example for PR Workflow:
View Medium Priority Opportunities
🟡 Medium Priority
Opportunity 4: Adopt Safe-Inputs for Secret Management
What: Safe-inputs feature provides secure secret injection but has very low adoption.
Why It Matters:
Where: Workflows needing API keys, tokens, or sensitive configuration:
How to Implement:
Opportunity 5: Use Custom CLI Arguments (engine.args)
What: No workflows use
engine.argsto pass custom CLI arguments to Copilot.Why It Matters:
Where: Advanced workflows needing:
How to Implement:
Opportunity 6: Optimize Timeout Settings
What: Most workflows use default 30-minute timeout, but some tasks may benefit from tuning.
Why It Matters:
Where:
How to Implement:
Analysis Recommendations:
Opportunity 7: Adopt Repo-Memory for Cross-Run State
What: Repo-memory tool has moderate adoption but could benefit more workflows.
Why It Matters:
Where: Workflows that would benefit from memory:
Current Usage: Moderate (some workflows use it)
How to Implement:
Opportunity 8: Leverage Cache-Memory for Within-Run State
What: Cache-memory provides within-run state management for complex workflows.
Why It Matters:
Where: Workflows with multiple processing phases:
Current Usage: Moderate adoption
How to Implement:
View Low Priority Opportunities
🟢 Low Priority
Opportunity 9: Use Model Overrides Strategically
What: Model overrides exist but are limited to cost-saving models (
gpt-5.1-codex-mini).Why It Matters:
Where:
How to Implement:
Opportunity 10: Pin Versions for Critical Workflows
What: Most workflows use default "latest" version, which auto-updates.
Why It Matters:
Where: Production-critical workflows that need stability:
How to Implement:
Opportunity 11: Explore Custom Environment Variables
What:
engine.envfield allows custom environment variables but is rarely used.Why It Matters:
How to Implement:
Opportunity 12: Create Workflow Templates
What: No standardized workflow templates for common patterns.
Why It Matters:
Recommendation: Create templates for:
4️⃣ Specific Workflow Recommendations
View Workflow-Specific Recommendations
Workflow:
smoke-copilot.mdCurrent State: Comprehensive smoke test with many tools (github, playwright, serena, web-fetch, cache-memory, edit, bash, agentic-workflows)
Recommended Changes:
Expected Benefits: Faster execution, clearer tool permissions
Workflow:
archie.mdCurrent State: Go architecture analysis with serena and GitHub tools
Recommended Changes:
goplsplugin for enhanced Go intelligencetoolsets: [repos]instead of generic defaultExpected Benefits: Better Go code understanding, trend analysis
Workflow:
jsweep.mdCurrent State: JavaScript cleanup and refactoring
Recommended Changes:
Expected Benefits: Enhanced JavaScript analysis, stable execution
Workflow:
grumpy-reviewer.mdCurrent State: Code review with critical perspective
Recommended Changes:
engine.agent: grumpy-reviewerto reference.github/agents/grumpy-reviewer.agent.mdtoolsets: [pull_requests]instead of defaultExpected Benefits: Native agent support, focused permissions, faster execution
Workflow:
dev.mdCurrent State: Development workflow
Recommended Changes:
developer.instructions.mdviaengine.agent: developerExpected Benefits: Specialized developer agent, enhanced tooling
Workflow:
research.mdCurrent State: Research and analysis workflow
Recommended Changes:
Expected Benefits: Historical tracking, sufficient time, intermediate state management
5️⃣ Trends & Insights
View Historical Trends
First Analysis Notice:
This is the first comprehensive Copilot CLI deep research analysis for this repository. Future runs will compare against this baseline to track:
Baseline Established (February 2026):
Next Analysis Recommendations:
6️⃣ Best Practice Guidelines
Based on this research, here are recommended best practices for Copilot workflows:
1. Use Specific GitHub Toolsets
Instead of
toolsets: [default], use specific toolsets like[issues],[pull_requests],[repos], or[actions]to reduce permission scope and improve clarity.2. Leverage Custom Agent Files
Reference specialized agents using
engine.agentfield to utilize the agent files in.github/agents/:3. Optimize Timeouts Based on Complexity
4. Use Repo-Memory for Stateful Workflows
Track trends and persist data across runs for quality metrics, performance analysis, and historical tracking:
5. Adopt Safe-Inputs for Secrets
When workflows need API keys or sensitive data, use safe-inputs instead of direct secret access:
6. Explore Plugins for Specialized Tasks
For code analysis and refactoring, add language-specific plugins:
7. Trust Auto-Configuration
The compiler automatically configures:
--sharefor conversation tracking--add-dirfor workspace access--disable-builtin-mcps--allow-all-pathswhen edit is enabledYou rarely need to override these defaults.
8. Use Model Overrides for Cost Optimization
For simple, high-volume tasks, use cost-effective models:
9. Network Firewall by Default
Most workflows already use network config for security. Continue this practice:
10. Combine Tools Strategically
The most effective workflows combine:
7️⃣ Action Items
Immediate Actions (this week):
engine.agentfield usage with examples from.github/agents/Short-term (this month):
Long-term (this quarter):
View Supporting Evidence & Methodology
📚 References
Copilot Engine Implementation:
pkg/workflow/copilot_engine.go- Core engine interfacepkg/workflow/copilot_engine_execution.go- Execution logic and CLI argument constructionpkg/workflow/copilot_engine_tools.go- Tool permissions and error patternspkg/workflow/copilot_mcp.go- MCP server configurationpkg/constants/constants.go- Copilot-related constants and versionsDocumentation:
docs/src/content/docs/reference/engines.md- Engine configuration guidedocs/src/content/docs/reference/copilot-custom-agents.md- Custom agent files guide.github/aw/github-agentic-workflows.md- Workflow configuration referenceWorkflow Examples:
.github/workflows/*.md- 213 workflow files analyzed.github/agents/*.md- 9 custom agent filesRepo Memory:
/tmp/gh-aw/repo-memory/default/copilot-research-2026-02-15.json- Analysis data/tmp/gh-aw/repo-memory/default/research-notes.md- Research notesResearch Methodology
Phase 1: Capability Inventory
copilot_engine.gofor supported features and capabilitiescopilot_engine_execution.gofor CLI flags and argumentsPhase 2: Usage Analysis
.github/agents/Phase 3: Gap Analysis
Phase 4: Validation
Data Collection Tools
Analysis Coverage
Limitations
Future Research Directions
References:
Beta Was this translation helpful? Give feedback.
All reactions