[Ascend][Doc] updated installation guide for Ascend NPU #13585
+105
−88
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
github-actions
bot
added
the
documentation
ping1jing2
reviewed
Nov 19, 2025
| @@ -0,0 +1,69 @@ | |||
| ## Examples | |||
Collaborator
There was a problem hiding this comment.
I think it would be better to change the file name to deepseek-family-examples.md
| #### vLLM | ||
|
|
||
| vLLM is still a major prerequisite on Ascend NPU. Because of `torch==2.6.0` limitation, only vLLM v0.8.5 is supported. | ||
| vLLM is still a major prerequisite on Ascend NPU. |
Collaborator
There was a problem hiding this comment.
I think vLLM is not a major prerequisite on Ascend NPU, but for SGLang
Comment on lines
89
to
+114
| #### Triton on Ascend | ||
| ```shell | ||
| BISHENG_NAME="Ascend-BiSheng-toolkit_aarch64.run" | ||
| BISHENG_URL="https://sglang-ascend.obs.cn-east-3.myhuaweicloud.com/sglang/${BISHENG_NAME}" | ||
| wget -O "${BISHENG_NAME}" "${BISHENG_URL}" && chmod a+x "${BISHENG_NAME}" && "./${BISHENG_NAME}" --install && rm "${BISHENG_NAME}" | ||
| ``` | ||
| ```shell | ||
| pip install triton-ascend==3.2.0rc4 | ||
| ``` | ||
| If you want to install Triton on Ascend nightly build or from sources, follow [installation guide](https://gitcode.com/Ascend/triton-ascend/blob/master/docs/sources/getting-started/installation.md) | ||
|
|
||
| _Notice:_ We recommend installing triton-ascend from source due to its rapid development, the version on PYPI can't keep up for know. This problem will be solved on Sep. 2025, afterwards `pip install` would be the one and only installing method. | ||
|
|
||
| Please follow Triton-on-Ascend's [installation guide from source](https://gitee.com/ascend/triton-ascend#2%E6%BA%90%E4%BB%A3%E7%A0%81%E5%AE%89%E8%A3%85-triton-ascend) to install the latest `triton-ascend` package. | ||
| #### SGLang Kernels NPU | ||
| For installation of SGLang Kernels NPU check the [installation guide](https://github.com/sgl-project/sgl-kernel-npu/blob/main/python/sgl_kernel_npu/README.md). | ||
|
|
||
| #### DeepEP-compatible Library | ||
|
|
||
| We are also providing a DeepEP-compatible Library as a drop-in replacement of deepseek-ai's DeepEP library, check the [installation guide](https://github.com/sgl-project/sgl-kernel-npu/blob/main/python/deep_ep/README.md). | ||
|
|
||
| #### CustomOps | ||
| _TODO: to be removed once merged into sgl-kernel-npu | ||
| ```shell | ||
| wget https://sglang-ascend.obs.cn-east-3.myhuaweicloud.com/ops/CANN-custom_ops-8.2.0.0-$DEVICE_TYPE-linux.aarch64.run | ||
| chmod a+x ./CANN-custom_ops-8.2.0.0-$DEVICE_TYPE-linux.aarch64.run | ||
| ./CANN-custom_ops-8.2.0.0-$DEVICE_TYPE-linux.aarch64.run --quiet --install-path=/usr/local/Ascend/ascend-toolkit/latest/opp | ||
| wget https://sglang-ascend.obs.cn-east-3.myhuaweicloud.com/ops/custom_ops-1.0.$DEVICE_TYPE-cp311-cp311-linux_aarch64.whl | ||
| pip install ./custom_ops-1.0.$DEVICE_TYPE-cp311-cp311-linux_aarch64.whl | ||
| ``` |
Collaborator
There was a problem hiding this comment.
How about using a table to collect these prerequisites？ Personally, I think it's a bit long to read
|
|
||
| ### Running DeepSeek-V3 | ||
|
|
||
| Running DeepSeek with PD disaggregation on 2 x Atlas 800I A3. |
Collaborator
There was a problem hiding this comment.
please add another qwen-family-examples.md
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Motivation
Modifications
Accuracy Tests
Benchmarking and Profiling
Checklist