We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 6fed266 commit 6dcade3Copy full SHA for 6dcade3
1 file changed
models/deepseek/deepseek-r1-distill-qwen-32b/metadata.yaml
@@ -9,8 +9,7 @@ spec:
9
- customRuntimeArgs:
10
- --max-model-len=32768
11
- --enforce-eager
12
- - --enable_reasoning
13
- - --reasoning_parser=deepseek_r1
+ - --reasoning-parser=deepseek_r1
14
- --gpu-memory-utilization=1
15
resourceRequirements:
16
cpu: 8
0 commit comments