Skip to content

update readme.md for fused moe #156

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

update readme.md for fused moe #156

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions python/deep_ep/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -59,6 +59,13 @@ python3 tests/python/deepep/test_intranode.py
python3 tests/python/deepep/test_low_latency.py
```

### moe
Adaptation for using fused moe with SGLang
1. Enable fused moe
export ENABLE_FUSED_MOE=1
2. Disable fused moe
export ENABLE_FUSED_MOE=0
Comment on lines +64 to +67
Copy link
Contributor

@gemini-code-assist gemini-code-assist bot Oct 31, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

For better readability and to make the commands easier to copy, it's a good practice to wrap shell commands in bash code blocks. This also helps visually separate the commands from the description.

Here is a suggested format:

1. Enable fused moe
   ```bash
   export ENABLE_FUSED_MOE=1
   ```
2. Disable fused moe
   ```bash
   export ENABLE_FUSED_MOE=0
   ```


### FAQ
1. If installing the `.whl` file results in the inability to import `deep_ep` in the project, check whether it is correctly installed in the `site-packages` directory of the current Python environment;
View installation path:
Expand Down
7 changes: 7 additions & 0 deletions python/deep_ep/README_CN.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -61,6 +61,13 @@ python3 tests/python/deepep/test_intranode.py
python3 tests/python/deepep/test_low_latency.py
```

### moe
适配sglang使用融合算子
1.开启融合算子
export ENABLE_FUSED_MOE=1
2.关闭融合算子
export ENABLE_FUSED_MOE=0
Comment on lines +66 to +69
Copy link
Contributor

@gemini-code-assist gemini-code-assist bot Oct 31, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

For better readability and to make the commands easier to copy, it's a good practice to wrap shell commands in bash code blocks. Also, adding a space after the list number is a good practice for markdown formatting.

Here is a suggested format:

1. 开启融合算子
   ```bash
   export ENABLE_FUSED_MOE=1
   ```
2. 关闭融合算子
   ```bash
   export ENABLE_FUSED_MOE=0
   ```


### 常见问题
1、如果安装`.whl`后，在工程中`import deep_ep`出现找不到`deep_ep`库，则检查是否正确安装到当前Python环境的`site-packages`目录下；
查看安装路径：
Expand Down
Loading