#Localllm
Showing 11 of 11 repositories tagged #localllm, ranked by stars
Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc
Run local LLMs like llama, deepseek-distill, kokoro and more inside your browser
A generalized information-seeking agent system with Large Language Models (LLMs).
[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs
The easiest & fastest way to run LLMs in your home lab
Native desktop app for Windows, MacOS and Linux. Easily run Large Language Models locally, no complex setups required. Inspired by OpenWebUI's simplicity for LLM use.
An open-source, privacy-first AI System Control Agent (JARVIS-like) using voice and hand gestures
Humanlike AI Chat is a terminal-based LLM UI designed to study how to bypass AI text detection.