Skip to content

Commit 87097bf

Browse files
author
xusenlin
committed
update vllm version
1 parent 2ba1d4d commit 87097bf

File tree

2 files changed

+3
-4
lines changed

2 files changed

+3
-4
lines changed

docker/Dockerfile.vllm

+1-1
Original file line numberDiff line numberDiff line change
@@ -6,6 +6,6 @@ COPY requirements.txt /workspace/
66

77
RUN pip config set global.index-url https://pypi.tuna.tsinghua.edu.cn/simple && \
88
pip install bitsandbytes --upgrade && \
9-
pip install vllm==0.4.2 && \
9+
pip install vllm==0.4.3 && \
1010
pip install --no-cache-dir -r /workspace/requirements.txt && \
1111
pip uninstall transformer-engine -y

docs/VLLM_SCRIPT.md

+2-3
Original file line numberDiff line numberDiff line change
@@ -15,10 +15,9 @@ docker build -f docker/Dockerfile.vllm -t llm-api:vllm .
1515
安装依赖,确保安装顺序严格按照下面的命令:
1616

1717
```shell
18-
pip install torch==2.1.0
19-
pip install vllm==0.4.2
18+
pip install vllm==0.4.3
2019
pip install -r requirements.txt
21-
pip uninstall transformer-engine -y
20+
# pip uninstall transformer-engine -y
2221
```
2322

2423
## 启动模型

0 commit comments

Comments
 (0)