In run_pplm_discrim_train.py get_generic_dataset() line 291:
if add_eos_token:
seq = [50256] + seq
I assume it addes an eos token to the sequence. However, it seems to be added at the beginning by these lines. Shouldn't eos be added to the end of the sequence?
In run_pplm_discrim_train.py get_generic_dataset() line 291:
ifadd_eos_token:seq = [50256] + seq
I assume it addes an eos token to the sequence. However, it seems to be added at the beginning by these lines. Shouldn't eos be added to the end of the sequence?