OnyxCore

English | 中文

Introduction

OnyxCore（ˈɑnɪks kɔr） Onyx → ​​Overlapping NPU​​（黑曜石的层叠纹理=>计算与通信的时空咬合） Core → ​​Kernel Acceleration​​（核心算力引擎）

Software and hardware

Supported Hardware Models: Atlas A3 Series Products Platform: aarch64/x86 Supporting Software

• Driver firmware Ascend HDK 25.0.RC1.1, CANN Community Edition 8.2.RC1.alpha001 and later versions (refer to the "CANN Software Installation Guide" to install the CANN development kit package, as well as the supporting firmware and drivers)
• Before installing CANN software, you need to install the relevant dependency list
• Python >= 3.9
• PyTorch >= 2.5.1, torch-npu >= 2.5.1-7.0.0

Quick Start

Compile and Run

1. Prepare the CANN environment variables (modify according to the installation path)

source /usr/local/Ascend/ascend-toolkit/set_env.sh

2. Build the project Before executing the engineering build script build.sh, modify _ASCEND_INSTALL_PATH on line 7 of build.sh according to the CANN installation path.

# Building Project
bash build.sh

# Link to the deep_ep_cpp.*.so file based on your settings
ln -s build/lib.linux-aarch64-cpython-39/deep_ep/deep_ep_cpp.cpython-39-aarch64-linux-gnu.so

# Run test cases
bash tests/run_test.sh

Installation

1. Run the installation script to install the .whl file into your Python environment

bash install.sh

Install required environment variables:

• ASCEND_HOME_PATH: CANN installation path

2. Execute the environment variables for CANN (modify according to the installation path)

source /usr/local/Ascend/ascend-toolkit/set_env.sh

3. In the Python project, import deep_ep.

FAQ

1. If installing the .whl file results in the inability to import deep_ep in the project, check whether it is correctly installed in the site-packages directory of the current Python environment; View installation path:

pip show deep-ep

2. If after installing the .whl, you encounter an issue where deep_ep_cpp is not found, you need to create a symbolic link of the deep_ep_cpp*.so files from the site-packages/deep_ep directory to the site-packages directory; Execute the following command in the site-packages directory:

ln -s deep_ep/deep_ep_cpp*.so