Search results

Cheval needs to be able to handle metadata

Status: Open.

#1551 In mlcommons/modelbench;

· superdosh opened on Jun 23, 2026

Calibration for security benchmark

Status: Open.

#1550 In mlcommons/modelbench;

· superdosh opened on Jun 23, 2026

Code attack decoder uses sut as a client

Status: Open.

#1548 In mlcommons/modelbench;

· bkorycki opened on Jun 22, 2026

DAG auditability

Status: Open.

#1545 In mlcommons/modelbench;

· superdosh opened on Jun 22, 2026

Confirm workability of DAG decoder

Status: Open.

#1543 In mlcommons/modelbench;

· bollacker opened on Jun 18, 2026

Modify DAG to use modelgauge

Status: Open.

#1542 In mlcommons/modelbench;

· bollacker opened on Jun 18, 2026

Create DAG scorers as Together dedicated endpoints

Status: Open.

#1541 In mlcommons/modelbench;

· bollacker opened on Jun 18, 2026

Assemble final jailbreak DAG

Status: Open.

#1540 In mlcommons/modelbench;

· bollacker opened on Jun 18, 2026

Composer bug fixes

Status: Open.

#1532 In mlcommons/modelbench;

· superdosh opened on Jun 12, 2026

Run a full (shell) DAG benchmark

Status: Open.

#1530 In mlcommons/modelbench;

· bollacker opened on Jun 9, 2026

Define the jailbreak benchmark in modelbench (use the shell annotator)

Status: Open.

#1529 In mlcommons/modelbench;

· bollacker opened on Jun 9, 2026

Migrate modelplane.evaluator to modelbench

Status: Open.

#1528 In mlcommons/modelbench;

· superdosh opened on Jun 9, 2026