Skip to content

Commit 78e7868

Browse files
author
Dylan Huang
committed
fix test
1 parent adf4745 commit 78e7868

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

tests/pytest/test_markdown_highlighting.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,7 @@ def markdown_dataset_to_evaluation_row(data: List[Dict[str, Any]]) -> List[Evalu
2626
dataset_adapter=markdown_dataset_to_evaluation_row,
2727
model=["accounts/fireworks/models/llama-v3p1-8b-instruct"],
2828
rollout_input_params=[{"temperature": 0.0, "max_tokens": 4096}],
29-
threshold_of_success=1.0,
29+
threshold_of_success=0.5,
3030
rollout_processor=default_single_turn_rollout_processor,
3131
num_runs=1,
3232
mode="pointwise",

0 commit comments

Comments
 (0)