All issues

Search results

GAIA image hardcodes web_search="live", which cannot be disabled and fails closed in air-gapped deployments

Status: Open.

#355 In Exgentic/eval-containers;

· natan-ergas opened on Aug 12, 2026

Five agents pass the task positionally: a task starting with "--" is parsed as an option

Status: Open.

#342 In Exgentic/eval-containers;

· elronbandel opened on Aug 11, 2026

gateways/bifrost: image fails to build on-cluster — catalog warm never becomes healthy

Status: Open.

#300 In Exgentic/eval-containers;

· elronbandel opened on Aug 9, 2026

Remove per-model gateway images — one shared model gateway, models are runtime-only

Status: Open.

#294 In Exgentic/eval-containers;

· elronbandel opened on Aug 9, 2026

aider-polyglot: 3 rust exercises are unsolvable offline (crates.io dependencies)

Status: Open.

#291 In Exgentic/eval-containers;

· elronbandel opened on Aug 6, 2026

Code benchmarks derive the verdict from an exit status the agent's own code controls

Status: Open.

#290 In Exgentic/eval-containers;

· elronbandel opened on Aug 6, 2026

aider-polyglot: agent gets no test feedback, and java tasks leak the tests

Status: Open.

#288 In Exgentic/eval-containers;

· elronbandel opened on Aug 6, 2026

aider-polyglot: Java tasks leak the hidden test file into the agent workspace (47/47 tasks)

Status: Open.

#287 In Exgentic/eval-containers;

· natan-ergas opened on Aug 6, 2026

bug: eval.benchmark.upstream_base is a per-task fact under the benchmark prefix

Status: Open.

#284 In Exgentic/eval-containers;

· elronbandel opened on Aug 5, 2026

Own envsubst in the gateway (retire per-benchmark gettext-base)

Status: Open.

#257 In Exgentic/eval-containers;

· elronbandel opened on Jul 5, 2026

Shrink the runtime base images to cut CVE surface (distroless / Chainguard / trimmed Debian)

Status: Open.

#247 In Exgentic/eval-containers;

· elronbandel opened on Jun 29, 2026

fix(eval): use named contexts in bake file so eval→bench/agent dependency is explicit in the build graph

Status: Open.

#216 In Exgentic/eval-containers;

· elronbandel opened on Jun 21, 2026