Skip to content

questions about QAT #116

@13185742215

Description

@13185742215

QAT训练完之后保存的pth模型中找不到QDQ节点或伪量化节点,导出成onnx后也找不到,且精度都是fp32的,如何解决?
请问如何到导出成带有QDQ节点的模型,如何进行int8推理(不使用tensorrt)?

readme中说# then following the post training quantization process,这是什么意思,是否在QAT之后要做一遍PTQ?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions