Skip to content

bench eval create should expose --max-retries alias #916

Description

@bingran-you

Mirrors Linear ENG-169: https://linear.app/benchflow/issue/ENG-169/cli-expose-max-retries-on-bench-eval-create

Problem

bench eval create supports retry control via YAML max_retries and CLI --retry-attempts, but users naturally try --max-retries and get No such option.

Expected

--max-retries should be a first-class CLI alias for the current retry-attempt override and work for both --tasks-dir and --config eval runs. Passing both aliases should fail fast instead of silently choosing one.

Current fix path

Daily scan 2026-07-11 confirmed this is a narrow BenchFlow CLI issue. A focused PR is being prepared.

Metadata

Metadata

Assignees

No one assigned

    Labels

    P2Anti-pattern / type safety / docs precision / minor schema drift / non-deterministic but contained.area:evalIssue / PR lives primarily in the "eval" subsystem.bugSomething isn't workingreviewingFix PR open and awaiting reviewstatus:in-progressHas assignee or linked draft PR.

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    Status
    In Progress

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions