Are we supposing the same length for each sentence in the position encoding?
|
l = [[(1 - s/(slen-1)) - (e/(elen-1)) * (1 - 2*s/(slen-1)) for e in range(elen)] for s in range(slen)] |
As in above, each sentence encoding is divided by the same number elen-1.
Are we supposing the same length for each sentence in the position encoding?
Dynamic-memory-networks-plus-Pytorch/babi_main.py
Line 18 in ad49955
As in above, each sentence encoding is divided by the same number elen-1.