Search results

Differences between memory efficient attention and vanilla eager attention

Status: Open.

#9 In lucidrains/memory-efficient-attention-pytorch;

· nbui-sc opened on Jul 8, 2025

Example for long embedding sequence prediction using this attention

Status: Open.

#8 In lucidrains/memory-efficient-attention-pytorch;

· ramdhan1989 opened on Jun 3, 2024

Making this work with relative position bias from XTransformers

Status: Open.

#5 In lucidrains/memory-efficient-attention-pytorch;

· pfeatherstone opened on Dec 2, 2022

save_for_backward can only save variables, but argument 5 is of type bool

Status: Open.

#4 In lucidrains/memory-efficient-attention-pytorch;

· abalikhan opened on Oct 26, 2022

Checkpointing is not compatible with .grad() or when an <code>inputs</code> parameter is passed to .backward()

Status: Open.

#3 In lucidrains/memory-efficient-attention-pytorch;

· vrobot opened on Oct 5, 2022