#Llm-training
Showing 50 of 50 repositories tagged #llm-training, ranked by stars
Find secrets with Gitleaks 🔑
本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）
Low-code framework for building custom LLMs, neural networks, and other AI models
Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).
Efficient Triton Kernels for LLM Training
Democratizing Reinforcement Learning for LLMs
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/
MoBA: Mixture of Block Attention for Long-Context LLMs
OpenLake is a high performance storage engine for efficient LLM inference and GPU Training
DLRover: An Automatic Distributed Deep Learning System
Nvidia GPU exporter for prometheus using nvidia-smi binary
GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generation
“AI-Compass”将为社区指引在 AI 技术海洋中航行的方向，无论你是初学者还是进阶开发者，都能在这里找到通往 AI 各大方向的路径。旨在帮助开发者系统性地了解 AI 的核心概念、主流技术、前沿趋势，并通过实践掌握从理论到落地的全过程。
Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
历年ICLR论文和开源项目合集，包含ICLR2021、ICLR2022、ICLR2023、ICLR2024、ICLR2025.
LLM (Large Language Model) FineTuning
irresponsible innovation. Try now at https://chat.dev/
A curated collection of papers, technical reports, frameworks, and tools for on-policy distillation (OPD) of large language models
Repo for fine-tuning Casual LLMs
The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.
Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)
LightRFT: Light, Efficient, Omni-modal & Reward-model Driven Reinforcement Fine-Tuning Framework
APOLLO: SGD-like Memory, AdamW-level Performance; MLSys'25 Oustanding Paper Honorable Mention
PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal acceleration.
电子鹦鹉 / Toy Language Model
A native Mac App for LLM fine-tuning on Apple Silicon — fully on-device, fully open source.
Full-stack open-source AI engine for building language models — tokenizer training, transformer architecture, cognitive reasoning and chat pipeline.
A curated list of papers, tools, and resources on Multi-Token Prediction (MTP) and related techniques in Large Language Models (LLMs), Speech-Language Models (SLMs), and more.
Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).
Repository for organizing datasets and papers used in Open LLM.
Cyber-Zero: Training Cybersecurity Agents Without Runtime
A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
A benchmark for evaluating learning agents based on just language feedback
🚀 Easy, open-source LLM finetuning with one-line commands, seamless cloud integration, and popular optimization frameworks. ✨
Toolchain built around the Megatron-LM for Distributed Training
逐行对照 MiniMind 源码精读、并延伸到大模型技术体系的中文学习笔记 —— 预训练 / SFT / DPO / PPO / GRPO、训练机制、MiniMind2→3 版本对照、真实实验证据。
a novel architecture that leverages Autoencoders to superimpose the hidden representations of a base model and a fine-tuned model within a shared parameter space. Using B-spline-based blending coefficients and autoencoders that adaptively reconstruct the original hidden states based on the input data distribution.
A powerful 130-million-parameter model trained from scratch as part of a truly open-source stack, including a custom tokenizer, dataset, and optimizer.
It is a comprehensive resource hub compiling all LLM papers accepted at the International Conference on Learning Representations (ICLR) in 2024.
Curated, opinionated index of post-R1 LLM × Reinforcement Learning. Many deep-dive blog posts cross-linked to many papers — GRPO, DAPO, DPO, PPO, RLHF, GSPO, CISPO, VAPO, Reward Modeling, MoE RL stability, Verifier-Free RL, Training-Free RL, Agentic RL, DeepSeek-R1 reproduction.
Large Language Model for Blockchain
npm like package ecosystem for Prompts 🤖
Litmus is a comprehensive LLM testing and evaluation tool designed for GenAI Application Development. It provides a robust platform with a user-friendly UI for streamlining the process of building and assessing the performance of your LLM-powered applications.
本项目旨在结合以往研究人员的代表性工作，从多个维度评估sft数据，并自动化过滤sft数据。
PHP Laravel Library for Scrapingbee Web Scraping API. AI querying supported. Also support Google, Walmart, Amazon, YouTube scraping
Qelm - Quantum Enhanced Language Model
MER is a software that identifies and highlights manipulative communication in text from human conversations and AI-generated responses. MER can evaluate LLM responses for manipulative expressions, fostering development of transparency and safety in AI. It also supports manipulation victims by detecting manipulative patterns in human communication.