#Deepspeed
Showing 13 of 13 repositories tagged #deepspeed, ranked by stars
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
An Open-sourced Knowledgable Large Language Model Framework.
GLake: optimizing GPU memory management and IO transmission.
Large Language Models for All, 🦙 Cult and More, Stay in touch !
Implementation of Chinese ChatGPT
A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the ChatGLM architecture. Basically ChatGPT but with ChatGLM
Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
✏️0成本LLM微调上手项目，⚡️一步一步使用colab训练法律LLM，基于microsoft/phi-1_5、chatglm3，包含lora微调，全参微调
A full pipeline to finetune Alpaca LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Alpaca architecture. Basically ChatGPT but with Alpaca
Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library
All about large language models
End-to-end training of Retrieval-Augmented LMs (REALM, RAG)