Add Windsurf/Codeium adapter

[jackjin1997]

Context

Windsurf (by Codeium) is gaining traction as an AI coding IDE. Adding it would round out the benchmark with another IDE-based agent.

Community contributions welcome — especially from Windsurf users who can help test.

Implementation

~15 lines with our template method pattern. See adapters/claude_code.py for reference.

[IlyasFardaouix]

I'm not seeing any implementation details for the Windsurf adapter, just a mention of using our template method pattern like in adapters/claude_code.py. Can you share the Windsurf-specific code or point out what's different about this adapter that makes it harder to implement?

[jackjin1997]

Good question. The challenge with Windsurf is similar to Cursor — it's an IDE, not a CLI tool. Our adapters work by invoking a CLI command in a sandboxed workspace:

class YourAgentAdapter(AgentAdapter):
    name = "your-agent"
    cli_command = "your-agent-cli"

    def _build_command(self, prompt: str) -> list[str]:
        return ["your-agent-cli", "--prompt", prompt]

So any agent that has a non-interactive CLI mode (like claude --print or aider --message) can be adapted in ~15 lines.

For Windsurf specifically: if Codeium exposes a CLI or API for headless execution, it would be straightforward. Otherwise, we'd need to investigate whether their extension API can be scripted. If anyone from the Windsurf/Codeium community has insights, we'd love to hear them.

In the meantime, we're prioritizing CLI-native agents (Codex CLI, Aider) for the next batch.

[IlyasFardaouix]

I see the challenge now. It seems Windsurf also lacks a non-interactive CLI mode, which complicates the implementation. Have you considered using Windsurf's API to fetch the code completion suggestions, as mentioned in their documentation? We could use that to populate the cli_command with an API endpoint instead of a CLI command. Would that be a viable direction to explore?