PyTorch Local Windowed Attention Transformer Implementation by lucidrains

https://github.com/lucidrains/local-attention

Code as of 12/11/2022

Dependencies:

1) PyTorch (pip install torch)

2) einops (pip install einops)

Project Los Angeles

Tegridy Code 2022