#Rlhf
Showing 60 of 73 repositories tagged #rlhf, ranked by stars
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
The official GitHub page for the survey paper "A Survey of Large Language Models".
Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).
中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)
Robust recipes to align language models with human and AI preferences
OpenClaw-RL: Train any agent simply by talking
Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.
Implement a reasoning LLM in PyTorch from scratch, step by step
A curated list of reinforcement learning with human feedback resources (continually updated)
Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调
Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.
🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.
Textbook on reinforcement learning from human feedback
An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
Awesome List for Agentic RL
Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
WebGLM: An Efficient Web-enhanced Question Answering System (KDD 2023)
Recipes to train reward model for RLHF.
Xtreme1 is an all-in-one data labeling and annotation platform for multimodal data training and supports 3D LiDAR point cloud, image, and LLM.
[NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward
“AI-Compass”将为社区指引在 AI 技术海洋中航行的方向，无论你是初学者还是进阶开发者，都能在这里找到通往 AI 各大方向的路径。旨在帮助开发者系统性地了解 AI 的核心概念、主流技术、前沿趋势，并通过实践掌握从理论到落地的全过程。
Aligning Large Language Models with Human: A Survey
OpenJudge: A Unified Framework for Holistic Evaluation and Quality Rewards
🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.
Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (LLM).
Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.
The official implementation of Self-Play Preference Optimization (SPPO)
Implementation of ChatGPT RLHF (Reinforcement Learning with Human Feedback) on any generation model in huggingface's transformer (blommz-176B/bloom/gpt/bart/T5/MetaICL)
A recipe for online RLHF and online iterative DPO.
A curated collection of papers, technical reports, frameworks, and tools for on-policy distillation (OPD) of large language models
MindSpore online courses: Step into LLM
An Asynchronous Reinforcement Learning Engine for Omni-Modal Post-Training at Scale
LLM Tuning with PEFT (SFT+RM+PPO+DPO with LoRA)
Code For Adaptive-Boundary-Clipping GRPO. arxiv.org/pdf/2601.03895
A curated collection of papers and resources on On-Policy Distillation for Large Language Models.
pykoi: Active learning in one unified interface
The Official Repo for "Quick Start Guide to Large Language Models"
A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.
An Efficient "Factory" to Build Multiple LoRA Adapters
🛰️ 基于真实医疗对话数据在ChatGLM上进行LoRA、P-Tuning V2、Freeze、RLHF等微调，我们的眼光不止于医疗问答
A visuailzation tool to make deep understaning and easier debugging for RLHF training.
Bilingual (中文+EN) ML / LLM / diffusion / agent interview cheat sheets for AI 秋招 — generated by ARIS /interview-cheatsheet, rendered by /render-html into single-file HTML, reads anywhere — plus a CV→DBLP-fact-checked academic homepage generator and hand-authored long-form blogs 🌱
LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA
A native Mac App for LLM fine-tuning on Apple Silicon — fully on-device, fully open source.
A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Vicuna architecture. Basically ChatGPT but with Vicuna
BeaverTails is a collection of datasets designed to facilitate research on safety alignment in large language models (LLMs).
Implementation of Reinforcement Learning from Human Feedback (RLHF)
Official Implementation of VideoDPO
A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the ChatGLM architecture. Basically ChatGPT but with ChatGLM
A comprehensive guide to Reinforcement Learning
An LLM training framework built from the ground up, featuring a custom BumbleBee architecture and end-to-end support for multiple open-source models across Pretraining → SFT → RLHF/DPO.
LLM alignment jailbreak; a set of instructions for auditing their internal reasoning and uncovering biases
Python client library for improving your LLM app accuracy
逐行对照 MiniMind 源码精读、并延伸到大模型技术体系的中文学习笔记 —— 预训练 / SFT / DPO / PPO / GRPO、训练机制、MiniMind2→3 版本对照、真实实验证据。
A PyTorch implementation of the paper "Provably Efficient Online RLHF with One-Pass Reward Modeling". This repository provides a flexible and modular approach to Online Reinforcement Learning from Human Feedback (Online RLHF).
Rank images using TrueSkill by comparing them against each other in the browser. 🖼📊
A travel agent based on Qwen2.5, fine-tuned by SFT + DPO/PPO/GRPO using traveling question-answer dataset, a mindmap can be output using the response. A RAG system is build upon the tuned qwen2, using Prompt-Template + Tool-Use + Chroma embedding database + LangChain
A High-Efficiency System of Large Language Model Based Search Agents