Implementation of Universal Transformer in Pytorch
-
Updated
Nov 19, 2018 - Python
#
universal-transformer
Here are 7 public repositories matching this topic...
The implementation of Adaptive Computation function used in RNN "https://arxiv.org/pdf/1603.08983.pdf" and Universal Transformer Network "https://arxiv.org/pdf/1807.03819.pdf"
-
Updated
Aug 30, 2018 - Python
Universal Transformers implementation in PyTorch
-
Updated
Jul 14, 2022 - Python
Unofficial Implementation of Universal Transformer https://arxiv.org/abs/1807.03819
machine-learning deep-learning tensorflow adaptive-computation-time tensor2tensor self-attention universal-transformer
-
Updated
Oct 14, 2018 - Python
-
Updated
Aug 26, 2018 - Python
GPTs trained with shakespeare dataset. Includes: small 10.8M GPT mimicking Andrej Karpathy's video lecture, Universal Transformer with Adaptive Computation Time
-
Updated
May 20, 2024 - Python
Simple from-scratch implementations of transformer-based models that match the state of the art.
transformers transformer attention universal-transformer universal-transformers xlnet transformer-xl
-
Updated
Dec 8, 2022 - Python
Improve this page
Add a description, image, and links to the universal-transformer topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the universal-transformer topic, visit your repo's landing page and select "manage topics."