Skip to content

Commit 0aa5183

Browse files
update the ports to make the ports consistent in single host and multihost (vllm-project#938)
1 parent 8b1e8e7 commit 0aa5183

File tree

2 files changed

+4
-4
lines changed

2 files changed

+4
-4
lines changed

examples/disagg/run_disagg_single_host.sh

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -35,7 +35,7 @@ mkdir -p $HOME/logs
3535

3636
# Start prefill instances
3737
for i in $(seq 0 $((NUM_PREFILL_INSTANCES-1))); do
38-
PORT=$((8100 + i))
38+
PORT=$((8400 + i))
3939
KV_PORT=$((7100 + i))
4040
SIDE_PORT=$((6100 + i))
4141

@@ -61,7 +61,7 @@ done
6161

6262
# Start decode instances
6363
for i in $(seq 0 $((NUM_DECODE_INSTANCES-1))); do
64-
PORT=$((8200 + i))
64+
PORT=$((9400 + i))
6565
KV_PORT=$((7200 + i))
6666
# Same as prefill SIDE_PORT
6767
SIDE_PORT=$((6100 + i))

examples/disagg/toy_proxy_server.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -92,7 +92,7 @@ def parse_args():
9292
"--prefiller-port",
9393
type=int,
9494
nargs="+",
95-
default=[8100])
95+
default=[8400])
9696

9797
# For decoder instances
9898
parser.add_argument("--decoder-hosts",
@@ -104,7 +104,7 @@ def parse_args():
104104
"--decoder-port",
105105
type=int,
106106
nargs="+",
107-
default=[8200])
107+
default=[9400])
108108

109109
args = parser.parse_args()
110110

0 commit comments

Comments
 (0)