We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 2ba1d4d commit 87097bfCopy full SHA for 87097bf
docker/Dockerfile.vllm
@@ -6,6 +6,6 @@ COPY requirements.txt /workspace/
6
7
RUN pip config set global.index-url https://pypi.tuna.tsinghua.edu.cn/simple && \
8
pip install bitsandbytes --upgrade && \
9
- pip install vllm==0.4.2 && \
+ pip install vllm==0.4.3 && \
10
pip install --no-cache-dir -r /workspace/requirements.txt && \
11
pip uninstall transformer-engine -y
docs/VLLM_SCRIPT.md
@@ -15,10 +15,9 @@ docker build -f docker/Dockerfile.vllm -t llm-api:vllm .
15
安装依赖,确保安装顺序严格按照下面的命令:
16
17
```shell
18
-pip install torch==2.1.0
19
-pip install vllm==0.4.2
+pip install vllm==0.4.3
20
pip install -r requirements.txt
21
-pip uninstall transformer-engine -y
+# pip uninstall transformer-engine -y
22
```
23
24
## 启动模型
0 commit comments