PyTorch implementation of some attentions for Deep Learning Researchers.
pytorch
attention
multi-head-attention
location-sensitive-attension
dot-product-attention
location-aware-attention
additive-attention
relative-positional-encoding
relative-multi-head-attention
-
Updated
Mar 4, 2022 - Python