Skip to content

Encoding Long and Structured Inputs in Transformers

Notifications You must be signed in to change notification settings

borhanMorphy/ETC

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

19 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Extended Transformer Construction (ETC)

Contents

Installation

git clone https://github.com/borhanMorphy/ETC.git
cd ETC
pip install .

References

Citations

@inproceedings{ainslie2020etc,
  title={ETC: Encoding Long and Structured Data in Transformers},
  author={Joshua Ainslie and Santiago Onta{\~n}{\'o}n and Chris Alberti and Vaclav Cvicek and Zachary Fisher and Philip Pham and Anirudh Ravula and Sumit Sanghai and Qifan Wang and Li Yang},
  booktitle={Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020)},
  year={2020}
}

About

Encoding Long and Structured Inputs in Transformers

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages