Run with the quantization model (Only support run with single gpu) #176

Open

opened

on Dec 19, 2025

When can quantitative models be used to support multi-card inference?

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests