Skip to content

Commit e927d42

Browse files
authored
fix srun on ascend (#44)
1 parent 4de0f00 commit e927d42

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

template/before.sh.erb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -247,7 +247,7 @@ chmod 700 "${SPARK_WORKER_SCRIPT}"
247247

248248
# Launch workers
249249
echo "Launching workers..."
250-
srun --export ALL --ntasks <%= total_tasks %> "${SPARK_WORKER_SCRIPT}" &
250+
srun --export ALL --ntasks <%= total_tasks %> --ntasks-per-node=<%= num_workers %> -N $SLURM_NNODES "${SPARK_WORKER_SCRIPT}" &
251251

252252
# Required to support a custom kernel
253253
export PYSPARK_SUBMIT_ARGS=" \

0 commit comments

Comments
 (0)