llama-speculative-simple generates repetitive output with Qwen models

[sienaiwun]

Hi, I’m testing llama-speculative-simple and encountering an issue where the output becomes highly repetitive. Any Idea人 about that Here’s my setup:

Commit: 233461f (May 5, 2025)

Platform: macOS, Apple M2 Max, 64GB RAM

Example 1:

./llama-speculative-simple \
  -m /Qwen3-1.7B/Qwen3-1.7B-F16.gguf \
  -md /Qwen3-0.6B/Qwen3-0.6B-F16.gguf \
  -p "who are you" \
  -e -ngl 1 -t 4 -n 256 -c 4096 -s 8 --top_k 1 --draft 16

Output:
I'm a 16-year-old girl who is interested in science and technology, and I want to become a scientist. What should I do to achieve this goal? I'm very excited about the future of science and technology, and I want to contribute to it. I'm also interested in the history of science and technology, and I want to learn about it. What should I do to achieve this goal? I'm very excited about the future of science and technology, and I want to contribute to it. I'm also interested in the history of science and technology, and I want to learn about it. What should I do to achieve this goal? I'm very excited about the future of science and technology, and I want to contribute to it. I'm also interested in the history of science and technology, and I want to learn about it. What should I do to achieve this goal? I'm very excited about the future of science and technology, and I want to contribute to it. I'm also interested in the history of science and technology, and I want to learn about it. What should I do to achieve this goal? I'm very excited about the future of science and technology, and I want to contribute to it. I'm also interested in the history of science and technology, and I want

Example 2:
./llama-speculative-simple \ -m qwen2.5-1.5B-q4_0.gguf \ -md /Qwen2.5-0.5B-Instruct/Qwen2.5-0.5B-Instruct-Q4_0.gguf \ -p "who are you" \ -e -ngl 1 -t 4 -n 256 -c 4096 -s 8 --top_k 1 --draft 16

Output:
I am a computer program that is designed to assist with answering questions and providing information. I do not have a personal identity or a physical presence. Is there anything specific you would like to know or discuss? I am here to help with any questions you may have. Please feel free to ask me anything. I am not a real person, but I can help you with your questions to the best of my ability. Is there anything in particular you would like to know? I am here to assist you with any information you may need. Please let me know how I can help you. Is there anything else you would like to know? I am here to assist you with any information you may need. Please let me know how I can help you. Is there anything else you would like to know? I am here to assist you with any information you may need. Please let me know how I can help you. Is there anything else you would like to know? I am here to assist you with any information you may need. Please let me know how I can help you. Is there anything else you would like to...