#Attention-is-all-you-need
Showing 20 of 20 repositories tagged #attention-is-all-you-need, ranked by stars
A PyTorch implementation of the Transformer model in "Attention is All You Need".
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
Learn LLM internals step by step - from tokenization to attention to inference optimization.
My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
A Keras+TensorFlow Implementation of the Transformer: Attention Is All You Need
Neural Machine Translation with Keras
Implementation of the ScreenAI model from the paper: "A Vision-Language Model for UI and Infographics Understanding"
Implementation of "PaLM-E: An Embodied Multimodal Language Model"
Pytorch implementation of the models RT-1-X and RT-2-X from the paper: "Open X-Embodiment: Robotic Learning Datasets and RT-X Models"
Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper
Build your own Face App with Stable Diffusion 2.1
Final Project for AI Wireless
Pytorch Implementation of the sparse attention from the paper: "Generating Long Sequences with Sparse Transformers"
Multi heads attention for image classification
Implementation of Liquid Nets in Pytorch
Implementation of the transformer from the paper: "Real-World Humanoid Locomotion with Reinforcement Learning"
Implementation of AutoRT: "AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents"