#Vision-transformer
Showing 60 of 85 repositories tagged #vision-transformer, ranked by stars
OpenMMLab Detection Toolbox and Benchmark
pix2tex: Using a ViT to convert images of equations into LaTeX code.
[NeurIPS 2024 Best Paper Award][GPT beats diffusion๐ฅ] [scaling laws in visual generation๐] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!
Ingest, parse, and optimize any data format โก๏ธ from documents to multimedia โก๏ธ for enhanced compatibility with GenAI frameworks
SwinIR: Image Restoration Using Swin Transformer (official repository)
MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
OpenMMLab Pre-training Toolbox and Benchmark
Scenic: A Jax Library for Computer Vision Research and Beyond
Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
[CVPR 2025] Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone
The official repo for [NeurIPS'22] "ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation" and [TPAMI'23] "ViTPose++: Vision Transformer for Generic Body Pose Estimation"
[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.
An all-in-one toolkit for computer vision
All-in-one training for vision models (YOLO, ViTs, RT-DETR, DINOv3): pretraining, fine-tuning, distillation.
Awesome List of Attention Modules and Plug&Play Modules in Computer Vision
Official PyTorch implementation of VoxFormer [CVPR 2023 Highlight]
[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.
SOTA Semantic Segmentation Models in PyTorch
Repository of Vision Transformer with Deformable Attention (CVPR2022) and DAT++: Spatially Dynamic Vision Transformerwith Deformable Attention
[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention
[NeurIPS 2021] You Only Look at One Sequence
[CVPR 2024] Alpha-CLIP: A CLIP Model Focusing on Wherever You Want
Vision-Centric BEV Perception: A Survey
Scene Text Recognition with Permuted Autoregressive Sequence Models (ECCV 2022)
[ECCV] Swin2SR: SwinV2 Transformer for Compressed Image Super-Resolution and Restoration. Advances in Image Manipulation (AIM) workshop ECCV 2022. Try it out! over 3.3M runs https://replicate.com/mv-lab/swin2sr
CAIRI Supervised, Semi- and Self-Supervised Visual Representation Learning Toolbox and Benchmark
TransMorph: Transformer for Unsupervised Medical Image Registration (PyTorch)
Hierarchical Image Pyramid Transformer - CVPR 2022 (Oral)
This repository provides programs to build Retrieval Augmented Generation (RAG) code for Generative AI with LlamaIndex, Deep Lake, and Pinecone leveraging the power of OpenAI and Hugging Face models for generation and evaluation.
๐ PILOT: A Pre-trained Model-Based Continual Learning Toolbox
Unofficial implementation for [ECCV'22] "Exploring Plain Vision Transformer Backbones for Object Detection"
Code release for ActionFormer (ECCV 2022)
[NeurIPS 2021] [T-PAMI] Global Filter Networks for Image Classification
[ECCV 2022] Official repository for "MaxViT: Multi-Axis Vision Transformer". SOTA foundation models for classification, detection, segmentation, image quality, and generative modeling...
Transformers 3rd Edition
a collection of visualization function
Official implementation of CrossViT. https://arxiv.org/abs/2103.14899
[CVPR 2024 Highlight] Logit Standardization in Knowledge Distillation
Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.
[Survey] Masked Modeling for Self-supervised Representation Learning on Vision and Beyond (https://arxiv.org/abs/2401.00897)
[ECCV2022] Official Implementation of paper "V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformer"
[NeurIPS 2022] HorNet: Efficient High-Order Spatial Interactions with Recursive Gated Convolutions
[ICCV 2023] You Only Look at One Partial Sequence
Inference Vision Transformer (ViT) in plain C/C++ with ggml
High-performance Image Tokenizers for VAR and AR
[CVPR'2022] SAM-DETR & SAM-DETR++: Official PyTorch Implementation
ๆถ้ ECCV ๆๆฐ็ๆๆ๏ผๅ ๆฌ่ฎบๆใไปฃ็ ๅdemo่ง้ข็ญ๏ผๆฌข่ฟๅคงๅฎถๆจ่๏ผ
Awesome Transformers (self-attention) in Computer Vision
A Simplified PyTorch Implementation of Vision Transformer (ViT)
Pytorch implementation of the models RT-1-X and RT-2-X from the paper: "Open X-Embodiment: Robotic Learning Datasets and RT-X Models"
AiTLAS implements state-of-the-art AI methods for exploratory and predictive analysis of satellite images.
Seq2SeqSharp is a tensor based fast & flexible deep neural network framework written by .NET (C#). It has many highlighted features, such as automatic differentiation, different network types (Transformer, LSTM, BiLSTM and so on), multi-GPUs supported, cross-platforms (Windows, Linux, MacOS), multimodal model for text and images and so on.
This repository contains all the work that I regularly did and studied from Medium blogs, several research papers, and other Repos (related/unrelated to the research papers).
Tutorials on machine learning, artificial intelligence, data science with math explanation and reusable code (in python and R)
PyTorch code for the paper "You Donโt Need Strong Assumptions: Visual Representation Learning via Temporal Differences"
[3DV 2022] The 8-Point Algorithm as an Inductive Bias for Relative Pose Prediction by ViTs
WACV 2024 Papers: Discover cutting-edge research from WACV 2024, the leading computer vision conference. Stay updated on the latest in computer vision and deep learning, with code included. โญ support visual intelligence development!
A comprehensive list [Hi-SAM@TPAMI'24, GoMatching@NeurIPS'24, DeepSolo(++)@ CVPR'23, DPText-DETR@AAAI'23, I3CL@IJCV'22] of our research works related to scene text detection, spotting, etc., including papers, codes.