Skip to content

Commit f5031c5

Browse files
Merge branch 'main' into feat/test-cpu-32-hk-workflow
2 parents 9fe5da2 + 2fdf85c commit f5031c5

1 file changed

Lines changed: 3 additions & 3 deletions

File tree

docs/source/user_guide/feature_guide/Ai_QoS_introduction_en.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -23,7 +23,7 @@
2323
## Build AI QoS Module
2424

2525
Build and install the AI QoS extension before using `tools/ai_qos.py`.
26-
The DSMI include/library paths are environment-dependent. Locate the paths on your machine first, then replace `YOUR_DSMI_INCLUDE_DIR` and `YOUR_DSMI_LIBRARY_FILE` in the command (for example, `/usr/local/Ascend/driver/include` and `/usr/local/Ascend/driver/lib64/driver/libdrvdsmi_host.so`).
26+
The DSMI include‑file (dsmi_common_interface.h) and library‑file (libdrvdsmi_host.so) paths are environment-dependent. Locate the paths on your machine first, then replace `YOUR_DSMI_INCLUDE_DIR` and `YOUR_DSMI_LIBRARY_FILE` in the command (for example, `/usr/local/Ascend/driver/include` and `/usr/local/Ascend/driver/lib64/driver/libdrvdsmi_host.so`).
2727

2828
In most deployments, these commands are executed inside a container. When creating the container, make sure the DSMI header/library directories are mounted into the container filesystem; otherwise CMake cannot find the files.
2929

@@ -51,7 +51,7 @@ cmake --install tools/ai_qos/build
5151

5252
​### 2) Manual mode
5353

54-
​python tools/ai_qos.py --mode manual --AIV_D2D *{priority}* --AIV_H2D *{priority}* --SDMA_D2D *{priority}* --SDMA_H2D *{priority}* --PCIEDMA_H2D *{priority}*
54+
​python tools/ai_qos.py --mode manual --AIV_D2D {priority} --AIV_H2D {priority} --SDMA_D2D {priority} --SDMA_H2D {priority} --PCIEDMA_H2D {priority}
5555

5656
​AI QoS manual mode calculates the QoS tag of traffic based on the priority of different types of traffic set by users, and generates and prints the UB switch configuration.You can copy the outputs and log in to the UB switch to configure the QoS configurations of UB switch. This configuration will overwrite the current QoS configuration on the UB switch. If there is any existing QoS configuration, please back it up in advance.
5757

@@ -60,7 +60,7 @@ cmake --install tools/ai_qos/build
6060
| Name | Type | Default | Description |
6161
| ----------------- | ---- | ------------------------------------------------------------ | ------------------------------------------------------------ |
6262
| mode | str | auto | The mode of AI QoS, default mode is "auto", another mode is "manual",some parameters need to be configured if you choose "manual" mode. |
63-
| qos_manual_config | / | AIV_D2D: high,<br />AIV_H2D: high,<br />SDMA_D2D: high,<br />SDMA_H2D: low,<br />PCIEDMA_H2D: high | Parameters for "manual" mode, determined the QoS priority of different types of traffic. <br />The default configuration is the same as "auto" mode. <br />Typical traffic types are as follows for reference: AIV_D2D: AIV-based Device-to-Device communication, such as dispatch and combine.<br /> AIV_H2D: AIV-based Operator Delivery.<br /> SDMA_D2D: SDMA-based Device-to-Device communication, such as Allreduce and Allgather.<br />SDMA_H2D: SDMA-based Host-to-Device/Device-to-Host communication, such as KVCache offloading and prefetching.<br />PCIEDMA_H2D: PCIEDMA-based Operator Delivery. <br /> You can change the priority of different types of traffic, with "high/middle/low" options available.Due to hardware restrictions, "PCIEDMA_H2D" only supports "high/low" priority. |
63+
| AIV_D2D、AIV_H2D、SDMA_D2D、SDMA_H2D、PCIEDMA_H2D | str | AIV_D2D: high,<br />AIV_H2D: high,<br />SDMA_D2D: high,<br />SDMA_H2D: low,<br />PCIEDMA_H2D: high | Parameters for "manual" mode, determined the QoS priority of different types of traffic. <br />The default configuration is the same as "auto" mode. <br />Typical traffic types are as follows for reference: AIV_D2D: AIV-based Device-to-Device communication, such as dispatch and combine.<br /> AIV_H2D: AIV-based Operator Delivery.<br /> SDMA_D2D: SDMA-based Device-to-Device communication, such as Allreduce and Allgather.<br />SDMA_H2D: SDMA-based Host-to-Device/Device-to-Host communication, such as KVCache offloading and prefetching.<br />PCIEDMA_H2D: PCIe DMA-based Operator Delivery. <br /> You can change the priority of different types of traffic, with "high/middle/low" options available.Due to hardware restrictions, "PCIEDMA_H2D" only supports "high/low" priority. |
6464

6565
**How to disable AI QoS**:
6666

0 commit comments

Comments
 (0)