llama3 result is repeated many times

[pennypengpm]

llama3 result is repeated many times， as shown in above picture, how to fix it?

[XNLHZ]

me too, It is worth noted that I run the script on cuda12.1 and use torch version 2.1.2. Could this be the reason?