Skip to content

Commit 486ed26

Browse files
committed
bug fix
1 parent ab953b1 commit 486ed26

File tree

1 file changed

+1
-1
lines changed
  • pretrain/scripts/v3-1.7b-exp2-cpt-2epoch-sakura

1 file changed

+1
-1
lines changed

pretrain/scripts/v3-1.7b-exp2-cpt-2epoch-sakura/train.sh

+1-1
Original file line numberDiff line numberDiff line change
@@ -54,7 +54,7 @@ GRAD_CLIP=1
5454
# 988240 + 988240 = 1976480
5555
LR_WARMUP_STEPS=2000
5656
LR_DECAY_ITERS=988240
57-
TRAIN_STEPS=$(((${LR_WARMUP_STEPS} + ${LR_DECAY_ITERS}) * 2)
57+
TRAIN_STEPS=$(((${LR_WARMUP_STEPS} + ${LR_DECAY_ITERS}) * 2))
5858

5959
# model config
6060
TOKENIZER_MODEL=${ENV_DIR}/src/llm-jp-tokenizer/models/ver3.0/llm-jp-tokenizer-100k.ver3.0b1.model

0 commit comments

Comments
 (0)