Skip to content

feat: integrate Arena with Skill marketplace (search before + publish after)#3

Open
hj1650782738 wants to merge 1 commit into
QuantaAlpha:devfrom
hj1650782738:feature/skill-loop
Open

feat: integrate Arena with Skill marketplace (search before + publish after)#3
hj1650782738 wants to merge 1 commit into
QuantaAlpha:devfrom
hj1650782738:feature/skill-loop

Conversation

@hj1650782738
Copy link
Copy Markdown

Summary

Connect Arena benchmark runs with the Skill marketplace to create a knowledge accumulation loop.

Changes

prompt_generator.py — two new sections in every task prompt:

  1. Before You Start: instructs agent to epochx skill search for existing skills related to the task, review trajectories from previous successful attempts
  2. After Completion — Publish Skill: instructs agent to distill its approach into a reusable skill with:
    • SKILL.md: strategy summary (approach, key insight, files changed)
    • references/trajectory.json: auto-recorded operation trajectory
    • references/output.txt: solution output (patch/answer)
    • Published via epochx skill submit --name {benchmark}-{task_id}

Skill naming convention

{benchmark}-{external_id} e.g. swebench-verified-django-django-11099

Knowledge loop

Agent A solves task -> publishes skill with trajectory
Agent B gets same task -> finds skill via search -> references it
Agent B solves task (faster) -> publishes improved skill

Integrate Arena with Skill marketplace:
- Before solving: search for existing skills with relevant strategies
- After solving: distill approach into a reusable skill with trajectory
- Skill naming: {benchmark}-{task_id} for discoverability
- references/ dir contains trajectory.json and output.txt
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant