#Lora

Showing 60 of 125 repositories tagged #lora, ranked by stars

hiyouga
hiyouga
LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Score
100
★ 73.1k ⑂ 8.9k +120/day
Python
labmlai
labmlai
annotated_deep_learning_paper_implementations

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

Score
94
★ 67.1k ⑂ 6.7k +11/day
Python
datawhalechina
datawhalechina
self-llm

《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调(全参数/Lora)、部署国内外开源大模型(LLM)/多模态大模型(MLLM)教程

Score
100
★ 31.2k ⑂ 3.0k +51/day
Jupyter Notebook
lyogavin
lyogavin
airllm

AirLLM 70B inference with single 4GB GPU

Score
99
★ 22.3k ⑂ 2.6k +103/day
Jupyter Notebook
huggingface
huggingface
peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Score
88
★ 21.4k ⑂ 2.4k +5/day
Python
ymcui
ymcui
Chinese-LLaMA-Alpaca

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

Score
75
★ 18.9k ⑂ 1.9k +2/day
Python
camenduru
camenduru
stable-diffusion-webui-colab

stable diffusion webui colab

Score
100
★ 15.9k ⑂ 2.6k
Jupyter Notebook
modelscope
modelscope
ms-swift

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025).

Score
81
★ 14.8k ⑂ 1.5k +10/day
Python
microsoft
microsoft
LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

Score
56
★ 13.6k ⑂ 913 +6/day
Python
OpenPipe
OpenPipe
ART

Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more!

Score
69
★ 10.3k ⑂ 938 +150/day
Python
yangjianxin1
yangjianxin1
Firefly

Firefly: 大模型训练工具,支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

Score
25
★ 6.6k ⑂ 584
Python
markqvist
markqvist
Reticulum

The cryptography-based networking stack for building unstoppable networks with LoRa, Packet Radio, WiFi and everything in between.

Score
62
★ 6.2k ⑂ 437 +60/day
Python
Akegarasu
Akegarasu
lora-scripts

SD-Trainer. LoRA & Dreambooth training scripts & GUI use kohya-ss's trainer, for diffusion model.

Score
50
★ 6.1k ⑂ 692 +11/day
Python
predibase
predibase
lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

Score
97
★ 3.8k ⑂ 323 +2/day
Python
mymusise
mymusise
ChatGLM-Tuning

基于ChatGLM-6B + LoRA的Fintune方案

Score
85
★ 3.7k ⑂ 436
Python
hiyouga
hiyouga
ChatGLM-Efficient-Tuning

Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调

Score
86
★ 3.7k ⑂ 462 +1/day
Python
aiming-lab
aiming-lab
MetaClaw

🦞 Just talk to your agent — it learns and EVOLVES 🧬.

Score
96
★ 3.5k ⑂ 445 +7/day
Python
agentheroes
agentheroes
agentheroes

Generate, animate and schedule your AI characters 🤖

Score
82
★ 3.4k ⑂ 77
TypeScript
ashishpatel26
ashishpatel26
LLM-Finetuning

LLM Finetuning with peft

Score
84
★ 3.0k ⑂ 769 +6/day
Jupyter Notebook
PhoebusSi
PhoebusSi
Alpaca-CoT

We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts to initiate any meaningful PR on this repo and integrate as many LLM related technologies as possible. 我们打造了方便研究人员上手和使用大模型等微调平台,我们欢迎开源爱好者发起任何有意义的pr!

Score
80
★ 2.8k ⑂ 249
Jupyter Notebook
liucongg
liucongg
ChatGLM-Finetuning

基于ChatGLM-6B、ChatGLM2-6B、ChatGLM3-6B模型,进行下游具体任务微调,涉及Freeze、Lora、P-tuning、全参微调等

Score
81
★ 2.8k ⑂ 308
Python
JIA-Lab-research
JIA-Lab-research
LongLoRA

Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)

Score
78
★ 2.7k ⑂ 285
Python
stochasticai
stochasticai
xTuring

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

Score
95
★ 2.7k ⑂ 210 +3/day
Python
absmach
absmach
magistrala

IoT Platform Framework

Score
0
★ 2.6k ⑂ 687 +2/day
Go
wenge-research
wenge-research
YAYI

雅意大模型:为客户打造安全可靠的专属大模型,基于大规模中英文多领域指令数据训练的 LlaMA 2 & BLOOM 系列模型,由中科闻歌算法团队研发。(Repo for YaYi Chinese LLMs based on LlaMA2 & BLOOM)

Score
77
★ 2.5k ⑂ 45
Python
chenking2020
chenking2020
FindTheChatGPTer

ChatGPT爆火,开启了通往AGI的关键一步,本项目旨在汇总那些ChatGPT的开源平替们,包括文本大模型、多模态大模型等,为大家提供一些便利

Score
76
★ 2.0k ⑂ 194
dphnAI
dphnAI
sonar

Large-scale LLM inference engine

Score
89
★ 1.8k ⑂ 202 +1/day
C++
meshtastic
meshtastic
Meshtastic-Android

Android application for Meshtastic

Score
0
★ 1.7k ⑂ 474 +15/day
Kotlin
ssbuild
ssbuild
chatglm_finetuning

chatglm 6b finetuning and alpaca finetuning

Score
67
★ 1.5k ⑂ 172
Python
zjunlp
zjunlp
KnowLM

An Open-sourced Knowledgable Large Language Model Framework.

Score
56
★ 1.4k ⑂ 133
Python
ARahim3
ARahim3
mlx-tune

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.

Score
94
★ 1.3k ⑂ 88 +6/day
Python
SakanaAI
SakanaAI
text-to-lora

Hypernetworks that adapt LLMs for specific benchmark tasks using only textual task description as the input

Score
72
★ 1.3k ⑂ 86
Python
SkalskiP
SkalskiP
vlms-zero-to-hero

This series will take you on a journey from the fundamentals of NLP and Computer Vision to the cutting edge of Vision-Language Models.

Score
44
★ 1.2k ⑂ 103
Jupyter Notebook
punica-ai
punica-ai
punica

Serving multiple LoRA finetuned LLM as one

Score
68
★ 1.2k ⑂ 64 +1/day
Python
unit-mesh
unit-mesh
unit-minions

《AI 研发提效:自己动手训练 LoRA》,包含 Llama (Alpaca LoRA)模型、ChatGLM (ChatGLM Tuning)相关 Lora 的训练。训练内容:用户故事生成、测试代码生成、代码辅助生成、文本转 SQL、文本生成代码……

Score
71
★ 1.1k ⑂ 126
Jupyter Notebook
NVlabs
NVlabs
DoRA

[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation

Score
31
★ 982 ⑂ 67
Python
ElectronicCats
ElectronicCats
CatSniffer

CatSniffer is an original multiprotocol and multiband board for sniffing, communicating, and attacking IoT (Internet of Things) devices using the latest radio IoT protocols. It is a highly portable USB stick that integrates TI CC1352, Semtech SX1262, and an RP2040 for V3 or a Microchip SAMD21E17 for V2

Score
100
★ 900 ⑂ 98 +10/day
Python
datawhalechina
datawhalechina
base-llm

从 NLP 到 LLM 的算法全栈教程,在线阅读地址:https://datawhalechina.github.io/base-llm/

Score
44
★ 880 ⑂ 97 +10/day
Jupyter Notebook
WangRongsheng
WangRongsheng
ChatGenTitle

🌟 ChatGenTitle:使用百万arXiv论文信息在LLaMA模型上进行微调的论文题目生成模型

Score
66
★ 835 ⑂ 70
Python
Finrandojin
Finrandojin
alexandria-audiobook

AI-powered multi-voice audiobook generator — LLM script annotation, voice cloning, voice design, LoRA training, per-line style control, and export to MP3, chaptered M4B, or Audacity multi-track. Built on Qwen3-TTS.

Score
38
★ 807 ⑂ 93 +807/day
Python
DaoyuanLi2816
DaoyuanLi2816
can-i-finetune-this

Estimate whether a Hugging Face model fits and fine-tunes on your local GPU.

Score
91
★ 790 ⑂ 106 +2/day
Python
SakanaAI
SakanaAI
doc-to-lora

Hypernetworks that update LLMs to remember factual information

Score
90
★ 773 ⑂ 100 +4/day
Python
AutoArk
AutoArk
TinyEngram

Research of DeepSeek Engram Architecture based on Qwen-3 and Stable Diffusion series.

Score
87
★ 736 ⑂ 51 +74/day
Python
X-D-Lab
X-D-Lab
MindChat

🐋MindChat(漫谈):漫谈人生路, 笑对风霜途

Score
59
★ 715 ⑂ 59
Python
sunrainyg
sunrainyg
RandOpt

Official Codebase for "Neural Thickets: Diverse Task Experts Are Dense Around Pretrained Weights" (ICML 2026 Spotlight)

Score
89
★ 623 ⑂ 68 +4/day
Python
GURPREETKAURJETHRA
GURPREETKAURJETHRA
END-TO-END-GENERATIVE-AI-PROJECTS

End to End Generative AI Industry Projects on LLM Models with Deployment_Awesome LLM Projects

Score
63
★ 602 ⑂ 171 +7/day
ukairia777
ukairia777
tensorflow-nlp-tutorial

tensorflow를 사용하여 텍스트 전처리부터, Topic Models, BERT, GPT, LLM과 같은 최신 모델의 다운스트림 태스크들을 정리한 Deep Learning NLP 저장소입니다.

Score
92
★ 577 ⑂ 286
Jupyter Notebook
Leeroo-AI
Leeroo-AI
mergoo

A library for easily merging multiple LLM experts, and efficiently train the merged LLM.

Score
56
★ 518 ⑂ 33
Python
richonguzman
richonguzman
LoRa_APRS_Tracker

LoRa APRS Tracker with Tx and Rx capabilities, Messages, Wx, Winlink and more...

Score
100
★ 494 ⑂ 137 +2/day
C++
lukeswitz
lukeswitz
AntiHunter

AntiHunter Perimeter Defense Systems - DIGI Node Firmware

Score
75
★ 485 ⑂ 69 +54/day
C++
zetavg
zetavg
LLaMA-LoRA-Tuner

UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT-like Chat UI to demonstrate your language models.

Score
22
★ 474 ⑂ 98 +1/day
Python
meshtastic
meshtastic
network-management-client

A Meshtastic desktop client, allowing simple, offline deployment and administration of an ad-hoc mesh communication network. Built in Rust and TypeScript.

Score
67
★ 471 ⑂ 45 +1/day
TypeScript
airaria
airaria
Visual-Chinese-LLaMA-Alpaca

多模态中文LLaMA&Alpaca大语言模型(VisualCLA)

Score
52
★ 461 ⑂ 37
Python
Joyce94
Joyce94
LLM-RLHF-Tuning

LLM Tuning with PEFT (SFT+RM+PPO+DPO with LoRA)

Score
47
★ 452 ⑂ 24 +1/day
Python
yuanjie-ai
yuanjie-ai
ChatLLM

轻松玩转LLM兼容openai&langchain,支持文心一言、讯飞星火、腾讯混元、智谱ChatGLM等

Score
54
★ 449 ⑂ 58
Jupyter Notebook
Saquib764
Saquib764
omini-kontext

An inference and training framework for multiple image input in Flux Kontext dev

Score
33
★ 442 ⑂ 34 +1/day
Jupyter Notebook
yangjianxin1
yangjianxin1
Firefly-LLaMA2-Chinese

Firefly中文LLaMA-2大模型,支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型

Score
46
★ 414 ⑂ 32
Python
datawhalechina
datawhalechina
llm-deploy

大模型/LLM推理和部署理论与实践

Score
48
★ 407 ⑂ 52 +1/day
bentoml
bentoml
BentoDiffusion

BentoDiffusion: A collection of diffusion models served with BentoML

Score
0
★ 387 ⑂ 29
Python
Hon-Wong
Hon-Wong
VoRA

[Fully open] [Encoder-free MLLM] Vision as LoRA

Score
44
★ 387 ⑂ 30
Python
Related Topics
#llm#llama#fine-tuning#peft#large-language-models#pytorch#transformers#qlora#chatglm#qwen#deep-learning#chatgpt

© 2026 GitRepoTrend · GitHub repositories by topic · Updated weekly