#Qwen3

Showing 40 of 40 repositories tagged #qwen3, ranked by stars

vllm-project
vllm-project
vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Score
100
★ 85.9k ⑂ 19.2k +24/day
Python
1Panel-dev
1Panel-dev
MaxKB

🔥 MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。

Score
86
★ 22.0k ⑂ 3.0k +15/day
Python
modelscope
modelscope
ms-swift

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025).

Score
71
★ 14.8k ⑂ 1.5k +10/day
Python
OpenPipe
OpenPipe
ART

Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more!

Score
57
★ 10.3k ⑂ 938 +150/day
Python
qualcomm
qualcomm
GenieX

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

Score
100
★ 8.2k ⑂ 1.0k +9/day
Rust
zilliztech
zilliztech
deep-searcher

Open Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.

Score
29
★ 7.9k ⑂ 767 +23/day
Python
xlite-dev
xlite-dev
Awesome-LLM-Inference

📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉

Score
43
★ 5.4k ⑂ 420 +19/day
Python
johnbean393
johnbean393
Sidekick

A native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your Mac without installing any other software. Powered by llama.cpp.

Score
0
★ 3.3k ⑂ 144 +1/day
Swift
papersgpt
papersgpt
papersgpt-for-zotero

A powerful Zotero AI and MCP plugin with ChatGPT, Gemini 3.5, Claude, DeepSeek V4, Grok, OpenRouter, Kimi 2.6, GLM 5, SiliconFlow, GPT-oss, Gemma 4, Qwen 3.7

Score
100
★ 2.5k ⑂ 85 +6/day
JavaScript
kubewall
kubewall
kubewall

kubewall - Single-Binary Kubernetes Dashboard with Multi-Cluster Management & AI Integration. (OpenAI / Claude 4 / Gemini / DeepSeek / OpenRouter / Ollama / Qwen / LMStudio)

Score
50
★ 1.9k ⑂ 97
TypeScript
meizhong986
meizhong986
WhisperJAV

ASR/STT subtitle generator. Uses Qwen3-ASR, local LLM, Whisper, TEN-VAD. Noise-robust for JAV

Score
96
★ 1.8k ⑂ 158 +27/day
Python
RunanywhereAI
RunanywhereAI
RCLI

Talk to your Mac, query your docs, no cloud required. On-device voice AI + RAG

Score
83
★ 1.5k ⑂ 83 +1/day
C++
ChaokunHong
ChaokunHong
MetaScreener

AI-powered tool for efficient abstract and PDF screening in systematic reviews.

Score
92
★ 1.3k ⑂ 47
Python
EvolvingLMMs-Lab
EvolvingLMMs-Lab
LLaVA-OneVision-2

Fully Open Framework for Democratized Multimodal Training

Score
88
★ 1.1k ⑂ 76 +4/day
Python
aiprodcoder
aiprodcoder
MIXAPI

大模型API网关-全新AI大模型接口管理与API聚合分发系统 , 支持将多种大模型转换成统一的OpenAI兼容接口,Claude接口,Gemini接口,可供个人或者企业内部大模型API 统一管理和渠道分发使用(key管理与二次分发),支持国际国内所有主流大模型,gemini,claude,qwen3,kimi-k2,豆包等,提供单可执行文件, docker镜像,一键部署,开箱即用,完全开源,自主可控!本项目基于New-API和One-API,整合了NewAPI,OneAPI所有功能及众多第三方插件为一身,功能超强!

Score
0
★ 1.0k ⑂ 274 +1.0k/day
Go
coderonion
coderonion
awesome-llm-and-aigc

🚀🚀🚀A collection of some awesome public projects about Large Language Model(LLM), Vision Language Model(VLM), Vision Language Action(VLA), AI Generated Content(AIGC), the related Datasets and Applications.

Score
33
★ 808 ⑂ 75
xushengfeng
xushengfeng
lime

大模型驱动的拼音输入法

Score
75
★ 769 ⑂ 36 +8/day
TypeScript
NVIDIA-NeMo
NVIDIA-NeMo
Automodel

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Score
79
★ 693 ⑂ 208 +3/day
Python
runebookai
runebookai
tome

a magical LLM desktop client that makes it easy for *anyone* to use LLMs and MCP

Score
50
★ 625 ⑂ 45
Svelte
yassa9
yassa9
qwen600

Static suckless single batch CUDA-only qwen3-0.6B mini inference engine

Score
42
★ 556 ⑂ 48
Cuda
openinfer-project
openinfer-project
openinfer

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

Score
100
★ 526 ⑂ 75 +5/day
Rust
nodetool-ai
nodetool-ai
nodetool

The open creative AI workspace

Score
71
★ 424 ⑂ 59 +3/day
TypeScript
AEON-7
AEON-7
Qwen3.6-27B-AEON-Ultimate-Uncensored-DFlash

Fully uncensored, capability-enhanced abliteration of Qwen3.6-27B. NVFP4 + z-lab DFlash speculative decoding (n=12) on the unified ghcr.io/aeon-7/aeon-vllm-ultimate:latest container, tuned for long-context draft acceptance on DGX Spark. 6 HF variants (BF16/NVFP4/MTP/MTP-XS), docker-compose, and QuickStart.

Score
67
★ 403 ⑂ 41 +3/day
Python
Quantatirsk
Quantatirsk
qwen3-asr

All in one Qwen3-ASR Server, compatible with OpenAI API

Score
0
★ 310 ⑂ 47 +8/day
Python
sophgo
sophgo
LLM-TPU

Run generative AI models in sophgo BM1684X/BM1688

Score
62
★ 292 ⑂ 49
C++
hud-evals
hud-evals
hud-python

OSS RL environment + evals toolkit

Score
14
★ 272 ⑂ 61 +1/day
Python
hogeheer499-commits
hogeheer499-commits
strix-halo-guide

Complete guide to running large language models locally on AMD Strix Halo / Ryzen AI MAX+ 395 with Radeon 8060S (gfx1151) and 96GB/128GB unified memory. Covers BIOS config, Ubuntu/kernel setup, Ollama, llama.cpp Vulkan/RADV, ROCm/HIP, vLLM, and 70B/120B GGUF evidence.

Score
58
★ 199 ⑂ 9 +5/day
Python
zhongkaifu
zhongkaifu
TensorSharp

A C# inference engine for running large language models (LLMs) locally using GGUF model files. TensorSharp provides a console application, a web-based chatbot interface, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/Linux with full GPU capability

Score
54
★ 186 ⑂ 15 +13/day
C#
cool-japan
cool-japan
oxibonsai

OxiBonsai is a zero-FFI, zero-C/C++ inference engine for PrismML's sub-2-bit Bonsai family — both the 1-bit line (Q1_0_g128) and the ternary line (TQ2_0_g128). It runs on CPU (SIMD), Apple Silicon (Metal), and NVIDIA (CUDA) without depending on llama.cpp, BLAS, or any C/Fortran runtime.

Score
0
★ 107 ⑂ 15
Rust
BeRo1985
BeRo1985
pasllm

PasLLM - LLM inference engine in Object Pascal (synced from my private work repository)

Score
38
★ 95 ⑂ 21
Pascal
alibaba
alibaba
InferSim

A Lightweight LLM Inference Performance Simulator

Score
46
★ 91 ⑂ 24
Python
FareedKhan-dev
FareedKhan-dev
qwen3-MoE-from-scratch

A Step-by-Step Implementation of Qwen 3 MoE Architecture from Scratch

Score
0
★ 81 ⑂ 9
Jupyter Notebook
aws-samples
aws-samples
easy-model-deployer

Deploy open-source LLMs on AWS in minutes — with OpenAI-compatible APIs and a powerful CLI/SDK toolkit.

Score
4
★ 77 ⑂ 19 +2/day
Python
taishan1994
taishan1994
LLM-Quantization

记录量化LLM中的总结。

Score
25
★ 77 ⑂ 9
Python
Liao-Ke
Liao-Ke
everyday

✨ 让经典名言焕发新生!基于LLM模型动态生成创意故事,用AI重新诠释金山每日一句的智慧结晶

Score
29
★ 66 ⑂ 11
Markdown
dinoanderson
dinoanderson
qwen_cli_coder

🤖 Community fork of Google's Gemini CLI for Qwen AI models. A powerful command-line tool that uses Alibaba Cloud's Qwen models to understand your code, automate workflows, and accelerate development. Features multilingual support (EN/CN), model switching, and web search integration.

Score
0
★ 61 ⑂ 23
TypeScript
amanning3390
amanning3390
flowstate-qmd

FlowState QMD — Anticipatory Memory for AI Agents. Hermes 2026 Hackathon Entry.

Score
17
★ 40 ⑂ 1 +4/day
TypeScript
obsfx
obsfx
promptscout

Enrich coding agent prompts with codebase context using a local LLM

Score
12
★ 34 ⑂ 3
TypeScript
Shuyib
Shuyib
tool_calling_api

This project demonstrates function-calling with Python and Ollama, utilizing the Africa's Talking API to send airtime and messages to phone numbers using natural language prompts. Ollama + LLM w/ functions + Natural language = User Interface for non-coders.

Score
21
★ 19 ⑂ 11
Python
dovvnloading
dovvnloading
Qwen3-TTS-1.7B

A desktop interface for the powerful Qwen3-TTS model (1.7B CustomVoice). Run offline, ultra-low latency text-to-speech with emotive control directly on your GPU.

Score
8
★ 16 ⑂ 3
TypeScript
Related Topics
#llm#qwen#deepseek#ai#gpt-oss#llama#deepseek-r1#ollama#llama3#llm-inference#openai#agent

© 2026 GitRepoTrend · GitHub repositories by topic · Updated weekly