[Local] Add seq-length gate for speculative decode#8

voipmonitor wants to merge 1301 commits into

mainvoipmonitor/vllm:mainfrom

sim/local-spec-disable-thresholdvoipmonitor/vllm:sim/local-spec-disable-thresholdCopy head branch name to clipboard