@@ -19,19 +19,16 @@ msgstr ""
1919"Plural-Forms : nplurals=1; plural=0;\n "
2020"Generated-By : Babel 2.18.0\n "
2121
22- #: ../../source/developer_guide/Design_Documents/quantization.md:3
2322msgid ""
2423"This document provides guidance for adapting quantization algorithms and "
2524"models related to **ModelSlim**."
2625msgstr "本文档为适配与 **ModelSlim** 相关的量化算法和模型提供指导。"
2726
28- #: ../../source/developer_guide/Design_Documents/quantization.md:9
2927msgid ""
3028"The current process for registering and obtaining quantization methods in "
3129"vLLM Ascend is as follows:"
3230msgstr "vLLM Ascend 中注册和获取量化方法的当前流程如下:"
3331
34- #: ../../source/developer_guide/Design_Documents/quantization.md:13
3532msgid ""
3633"vLLM Ascend registers a custom Ascend quantization method. By configuring "
3734"the `--quantization ascend` parameter (or `quantization=\" ascend\" ` for "
@@ -45,7 +42,6 @@ msgstr ""
4542"`AscendModelSlimConfig`,并调用 `get_quant_method` 来获取每个权重部分对应的量化方法,存储在 "
4643"`quant_method` 属性中。"
4744
48- #: ../../source/developer_guide/Design_Documents/quantization.md:15
4945msgid ""
5046"Currently supported quantization methods include `AscendLinearMethod`, "
5147"`AscendFusedMoEMethod`, `AscendEmbeddingMethod`, and their corresponding "
@@ -55,19 +51,16 @@ msgstr ""
5551"`AscendLinearMethod`、`AscendFusedMoEMethod`、`AscendEmbeddingMethod` "
5652"及其对应的非量化方法:"
5753
58- #: ../../source/developer_guide/Design_Documents/quantization.md:19
5954msgid ""
6055"The quantization method base class defined by vLLM and the overall call "
6156"flow of quantization methods are as follows:"
6257msgstr "vLLM 定义的量化方法基类以及量化方法的整体调用流程如下:"
6358
64- #: ../../source/developer_guide/Design_Documents/quantization.md:23
6559msgid ""
6660"The `embedding` method is generally not implemented for quantization, "
6761"focusing only on the other three methods."
6862msgstr "量化通常不实现 `embedding` 方法,只关注其他三种方法。"
6963
70- #: ../../source/developer_guide/Design_Documents/quantization.md:25
7164msgid ""
7265"The `create_weights` method is used for weight initialization; the "
7366"`process_weights_after_loading` method is used for weight post-processing, "
@@ -78,7 +71,6 @@ msgstr ""
7871"`create_weights` 方法用于权重初始化;`process_weights_after_loading` "
7972"方法用于权重的后处理,例如转置、格式转换、数据类型转换等;`apply` 方法用于在前向过程中执行激活量化和量化矩阵乘法计算。"
8073
81- #: ../../source/developer_guide/Design_Documents/quantization.md:27
8274msgid ""
8375"We need to implement the `create_weights`, `process_weights_after_loading`, "
8476"and `apply` methods for different **layers** (**attention**, **mlp**, **MoE "
@@ -87,7 +79,6 @@ msgstr ""
8779"我们需要针对不同的**层**(**attention**、**mlp**、**MoE (Mixture of Experts)**)实现 "
8880"`create_weights`、`process_weights_after_loading` 和 `apply` 方法。"
8981
90- #: ../../source/developer_guide/Design_Documents/quantization.md:29
9182msgid ""
9283"**Supplement**: When loading the model, the quantized model's description "
9384"file **quant_model_description.json** needs to be read. This file describes "
@@ -97,33 +88,28 @@ msgstr ""
9788"**补充**:加载模型时,需要读取量化模型的描述文件 "
9889"**quant_model_description.json**。该文件描述了模型权重各部分的量化配置和参数,例如:"
9990
100- #: ../../source/developer_guide/Design_Documents/quantization.md:49
10191msgid ""
10292"Based on the above content, we present a brief description of the adaptation"
10393" process for quantization algorithms and quantized models."
10494msgstr "基于以上内容,我们简要介绍量化算法和量化模型的适配流程。"
10595
106- #: ../../source/developer_guide/Design_Documents/quantization.md:73
10796msgid ""
10897"Adapting a new quantized model requires ensuring the following three points:"
10998msgstr "适配新的量化模型需要确保以下三点:"
11099
111- #: ../../source/developer_guide/Design_Documents/quantization.md:100
112100msgid ""
113101"vLLM Ascend supports multiple quantization algorithms. The following table "
114102"provides an overview of each quantization algorithm based on the "
115103"implementation in the `vllm_ascend.quantization` module:"
116104msgstr ""
117105"vLLM Ascend 支持多种量化算法。下表基于 `vllm_ascend.quantization` 模块中的实现,概述了每种量化算法:"
118106
119- #: ../../source/developer_guide/Design_Documents/quantization.md:112
120107msgid ""
121108"**Static vs Dynamic:** Static quantization uses pre-computed scaling factors"
122109" with better performance, while dynamic quantization computes scaling "
123110"factors on-the-fly for each token/activation tensor with higher precision."
124111msgstr "**静态 vs 动态:** 静态量化使用预计算的缩放因子,性能更好;动态量化为每个 token/激活张量实时计算缩放因子,精度更高。"
125112
126- #: ../../source/developer_guide/Design_Documents/quantization.md:114
127113msgid ""
128114"**Granularity:** Refers to the scope of scaling factor computation (e.g., "
129115"per-tensor, per-channel, per-group)."
0 commit comments