#

self-attention

Here are 303 public repositories matching this topic...

datawhalechina / leedl-tutorial

《李宏毅深度学习教程》（李宏毅老师推荐👍，苹果书🍎），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases

machine-learning tutorial reinforcement-learning deep-learning cnn transformer gan rnn pruning transfer-learning bert diffusion self-attention network-compression chatgpt leedl-tutorial

Updated Oct 8, 2024
Jupyter Notebook

zhouhaoyi / Informer2020

The GitHub repository for the paper "Informer" accepted by AAAI 2021.

deep-learning time-series pytorch transformer forecasting self-attention

Updated May 27, 2024
Python

cmhungsteve / Awesome-Transformer-Attention

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

computer-vision deep-learning transformers transformer awesome-list vit papers attention-mechanism attention-mechanisms self-attention transformer-architecture transformer-models detr vision-transformer transformer-cv transformer-with-cv transformer-awesome visual-transformer

Updated Jul 30, 2024

PetarV- / GAT

Graph Attention Networks (https://arxiv.org/abs/1710.10903)

python tensorflow neural-networks attention-mechanism graph-attention-networks self-attention

Updated Apr 9, 2022
Python

Diego999 / pyGAT

Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)

python pytorch neural-networks attention-mechanism graph-attention-networks self-attention

Updated Jul 6, 2023
Python

pytorch-GAT

gordicaleksa / pytorch-GAT

My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!

python deep-learning jupyter pytorch attention attention-mechanism graph-attention-networks self-attention pytorch-implementation gat graph-attention-network pytorch-gat gat-tutorial

Updated Nov 17, 2022
Jupyter Notebook

github / CodeSearchNet

Datasets, tools, and benchmarks for representation learning of code.

Updated Jan 31, 2022
Jupyter Notebook

microsoft / DeBERTa

The implementation of DeBERTa

deeplearning representation-learning language-model bert natural-language-understanding self-attention roberta transformer-encoder

Updated Sep 29, 2023
Python

speedinghzl / CCNet

CCNet: Criss-Cross Attention for Semantic Segmentation (TPAMI 2020 & ICCV 2019).

pytorch segmentation semantic-segmentation cityscape self-attention scene-parsing

Updated Mar 19, 2021
Python

DirtyHarryLYL / Transformer-in-Vision

Recent Transformer-based CV and related works.

computer-vision deep-learning paper transformer visual-language multi-modal self-attention vision-transformers

Updated Aug 22, 2023

self-attention-cv

The-AI-Summer / self-attention-cv

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

machine-learning deep-learning machine-learning-algorithms transformers artificial-intelligence transformer attention attention-mechanism self-attention

Updated Sep 14, 2021
Python

awesome-fast-attention

Separius / awesome-fast-attention

list of efficient attention modules

awesome transformer attention attention-is-all-you-need multihead-attention reformer self-attention transformer-network longformer linformer

Updated Aug 23, 2021
Python

brightmart / bert_language_understanding

Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

nlp text-classification question-answering document-classification transfer-learning fasttext language-model textcnn attention-is-all-you-need self-attention transformer-encoder bert-model pre-training language-understanding

Updated Jan 1, 2019
Python

prakashpandey9 / Text-Classification-Pytorch

Text classification using deep learning models in Pytorch

text-classification pytorch lstm-model glove rnn-model sentiment-classification attention-model self-attention

Updated Nov 17, 2018
Python

xxxnell / how-do-vits-work

(ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"

pytorch transformer self-attention loss-landscape vision-transformer

Updated Jul 14, 2022
Python

NVlabs / MambaVision

Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone

deep-learning transformers image-classification mamba visual-recognition self-attention hybrid-models huggingface-transformers vision-transformer foundation-models

Updated Oct 5, 2024
Python

NVlabs / FasterViT

[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention

deep-learning backbone image-classification coco object-detection semantic-segmentation visual-recognition ade20k self-attention image-net pre-trained-model vision-transformer foundation-models

Updated Jun 2, 2024
Python

kaituoxu / Speech-Transformer

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

end-to-end pytorch transformer attention asr attention-is-all-you-need self-attention

Updated Apr 6, 2023
Python

daiquocnguyen / Graph-Transformer

Universal Graph Transformer Self-Attention Networks (TheWebConf WWW 2022) (Pytorch and Tensorflow)

text-classification transformer graph-machine-learning graph-embeddings graph-classification self-attention graph-neural-networks graph-representation-learning transformer-models node-embeddings graph-deep-learning graph-transformer

Updated Aug 16, 2022
Python

jayparks / transformer

A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"

machine-translation attention-mechanism attention-is-all-you-need self-attention

Updated Oct 1, 2020
Python

Improve this page

Add a description, image, and links to the self-attention topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the self-attention topic, visit your repo's landing page and select "manage topics."