diff --git a/python/deep_ep/README.md b/python/deep_ep/README.md index 2143ab2e..a0cb8006 100644 --- a/python/deep_ep/README.md +++ b/python/deep_ep/README.md @@ -79,6 +79,16 @@ python3 tests/python/deepep/test_low_latency.py bash run_test_internode.sh ``` +### moe +1. Enable fused moe +```bash +export ENABLE_FUSED_MOE=1 +``` +2. Disable fused moe +```bash +export ENABLE_FUSED_MOE=0 +``` + ### FAQ 1. If installing the `.whl` file results in the inability to import `deep_ep` in the project, check whether it is correctly installed in the `site-packages` directory of the current Python environment; View installation path: diff --git a/python/deep_ep/README_CN.md b/python/deep_ep/README_CN.md index 3e48f607..703ec1c3 100644 --- a/python/deep_ep/README_CN.md +++ b/python/deep_ep/README_CN.md @@ -77,6 +77,17 @@ python3 tests/python/deepep/test_low_latency.py bash run_test_internode.sh ``` +### moe +适配sglang使用融合算子 +1. 开启融合算子 +```bash +export ENABLE_FUSED_MOE=1 +``` +2. 关闭融合算子 +```bash +export ENABLE_FUSED_MOE=0 +``` + ### 常见问题 1、如果安装`.whl`后,在工程中`import deep_ep`出现找不到`deep_ep`库,则检查是否正确安装到当前Python环境的`site-packages`目录下; 查看安装路径: