#Transformers
Showing 60 of 425 repositories tagged #transformers, ranked by stars
21 Lessons, Get Started Building with Generative AI
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
๐งโ๐ซ 60+ Implementations/tutorials of deep learning papers with side-by-side notes ๐; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), ๐ฎ reinforcement learning (ppo, dqn), capsnet, distillation, ... ๐ง
Learn it. Build it. Ship it for others.
Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
CVPR 2026 ่ฎบๆๅๅผๆบ้กน็ฎๅ้
๐ค PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
Machine Learning Engineering Open Book
Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.
Ongoing research training transformer models at scale
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
๐ก All-in-one AI framework for semantic search, LLM orchestration and language model workflows
A PyTorch-based Speech Toolkit
Semantic segmentation models with 500+ pretrained convolutional and transformer-based backbones.
๐ฅ Fast State-of-the-Art Tokenizers optimized for Research and Production
OpenVINOโข is an open source toolkit for optimizing and deploying AI inference
Open source real-time translation app for Android that runs locally
An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
[NeurIPS 2024 Best Paper Award][GPT beats diffusion๐ฅ] [scaling laws in visual generation๐] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!
SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformer
An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
A straightforward method for training your LLM, from downloading data to generating text.
BertViz: Visualize Attention in Transformer Models
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
Leveraging BERT and c-TF-IDF to create easily interpretable topics.
A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
SD.Next: All-in-one WebUI for AI generative image and video creation, captioning and processing
This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)
Open-source offline translation library written in Python
On-device Speech AI for Apple Silicon
Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
A concise but complete full-attention transformer with a set of promising experimental features from various papers
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
Robust recipes to align language models with human and AI preferences
โก Pure-Rust WebGPU inference engine โ OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
Chronos: Pretrained Models for Time Series Forecasting
OpenChat: Advancing Open-source Language Models with Imperfect Data
Superduper: End-to-end framework for building custom AI applications and agents.
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
A machine learning software for extracting information from scholarly documents
ใๅคงๆจกๅ็ฝ็ๅญๆๅปบๆๅใ๏ผไธไธชๅ จๆๆ็Tiny-Universe
Prompt Engineering, Generative AI, and LLM Guide by Learn Prompting | Join our discord for the largest Prompt Engineering learning community
LightGlue: Local Feature Matching at Light Speed (ICCV 2023)
๐100+ ๅๅ LLM / RL ๅ็ๅพ๐๏ผใๅคงๆจกๅ็ฎๆณใไฝ่ ๅทจ็ฎ๏ผ๐ฅ๏ผ100+ LLM/RL Algorithm Maps ๏ผ
Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research
Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun
State of the Art Natural Language Processing
โก๏ธSwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.
The Hugging Face course on Transformers
Scenic: A Jax Library for Computer Vision Research and Beyond
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Fine-tuning ChatGLM-6B with PEFT | ๅบไบ PEFT ็้ซๆ ChatGLM ๅพฎ่ฐ
๐ง ๐ฌ Articles I wrote about machine learning, archived from MachineCurve.com.