Skip to content

Commit 7064fc6

Browse files
authored
fix qwen3-8b-eagle3 max_position_embeddings (#271)
1 parent b04970f commit 7064fc6

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

configs/qwen3-8b-eagle3.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@
1111
"hidden_size": 4096,
1212
"initializer_range": 0.02,
1313
"intermediate_size": 12288,
14-
"max_position_embeddings": 2048,
14+
"max_position_embeddings": 40960,
1515
"max_window_layers": 36,
1616
"model_type": "llama",
1717
"num_attention_heads": 32,

0 commit comments

Comments
 (0)