You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on Nov 10, 2025. It is now read-only.
Describe the bug
When using decoding method "sample", the temperature is not handled correctly.
Platform
Please provide details about the environment you are using, including the following:
The bug is at vllm_in_proc.py:461