关闭vllm功能时的多gpu并行推理问题 #51

Open

opened

在关闭vllm功能后，正常设置多gpu推理会出现tensors所在的device不统一的问题

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests