Skip to content

Commit 24b0368

Browse files
seungrokjclaude
andcommitted
[AMD][MI355X] DSv4 SGLang: move PARALLEL_ARGS init before DPA block
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
1 parent 305b965 commit 24b0368

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

benchmarks/single_node/agentic/dsv4_fp4_mi355x_sglang.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -78,6 +78,7 @@ SGLANG_BACKEND_PORT="$PORT"
7878
ROUTER_LOG="$RESULT_DIR/router.log"
7979
MEM_FRACTION_STATIC=0.95
8080
CHUNKED_PREFILL_SIZE=16384
81+
PARALLEL_ARGS=(--tensor-parallel-size "$TP")
8182
if [ "$DP_ATTENTION" = "true" ]; then
8283
USE_SGLANG_ROUTER=true
8384
export AIPERF_HTTP_X_SMG_ROUTING_KEY_FROM_CORRELATION_ID=true
@@ -116,7 +117,6 @@ export SGLANG_USE_ROCM700A=0
116117
export SGLANG_HACK_FLASHMLA_BACKEND=unified_kv_triton
117118
export AITER_BF16_FP8_MOE_BOUND=0
118119

119-
PARALLEL_ARGS=(--tensor-parallel-size "$TP")
120120
METRICS_ARGS=(--enable-metrics)
121121
SPEC_ARGS=()
122122

0 commit comments

Comments
 (0)