#Local-ai
Showing 60 of 97 repositories tagged #local-ai, ranked by stars
Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (Meetly Ai - https://meetily.ai) is the #1 Self-hosted, Open-source Ai meeting note taker for macOS & Windows.
YC (S26) | AI that knows what you've seen, said, or heard. Records everything you do, say, hear 24/7, local, private, secure. Connect to OpenClaw, Hermes agent and 100+ apps
The open-source ElevenLabs alternative for local voice cloning, design, create, dubbing and dictation Desktop App
Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
β‘ Pure-Rust WebGPU inference engine β OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
Olares: An Open-Source Personal Cloud to Reclaim Your Data
All-in-One Native Local Development Environment for Windows, macOS & Linux. Docker alternative for PHP, Node.js, Python and more. Faster alternative to XAMPP, Laragon, MAMP and Laravel Herd with databases, Cron Jobs and runtime management.
Open-Source AI Camera Skills Platform, AI NVR & CCTV Surveillance. Local VLM video analysis with Qwen, DeepSeek, SmolVLM, LLaVA, YOLO26. LLM-powered agentic security camera agent β watches, understands, remembers & guards your home via Telegram, Discord or Slack. Pluggable AI skills. OpenAI, Google, Anthropic or local AI. Runs on Mac Mini & AI PC.
Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.
A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally
A privacy-preserving Raspberry Pi home security camera that uses advanced end-to-end encryption.
Talk to your Mac, query your docs, no cloud required. On-device voice AI + RAG
ποΈ AI Dictation App - Open Source and Local-first β‘ Type 3x faster, no keyboard needed. π Powered by open source models, works offline, fast and accurate.
A minimal LLM chat app that runs entirely in your browser
Your personal AI desktop agent for Windows, macOS, Linux & Android. Set a goal, it works on its own. Teams (pair two desktops, agents + humans), Agent2Agent, Workflows, Codework, multi-agent orgs, desktop + browser automation. 15+ AI providers, BYOK. No Docker, no terminal. Agent Skills (SKILL.md). Migration importer. Recurring autonomous tasks.
π¦θ·¨η«―δΊ€ζ₯γθΆη¨θΆζδ½ ηζ‘ι’ AI ε©ζββδΉθ½ζε‘εεΈΈι©»γθ·ε¨δΊδΈ | Desktop AI that hands off across your devices and gets to know you better β also runs headless on a NAS or in the cloud
Mobile-native local AI Agent framework for phones and edge devices, with an iOS runtime, fully offline local path, on-device models, native iOS Skills, and optional Mac Gateway inference
NativeMind: Your fully private, open-source, on-device AI assistant
Local AI app and inference engine for agents. Run open-weight LLMs locally β private, 100% offline on your computer.
Cotabby is local AI autocomplete for your entire Mac. Open source. On device. Everywhere you type.
Uncensored local AI desktop app: chat, agent mode, image & video generation. Run abliterated/uncensored LLMs + ComfyUI fully offline with your own provider. Single .exe, no Docker.
A cross-platform Flutter app that runs uncensored, 100% offline open-source AI models (GGUF) directly on your Android, iOS, or PC. No cloud, no filters, total privacy.
OpenβWebUI Tools is a modular toolkit designed to extend and enrich your Open WebUI instance, turning it into a powerful AI workstation. With a suite of over 15 specialized tools, function pipelines, and filters, this project supports academic research, agentic autonomy, multimodal creativity, workflows, and more
DocsAgent is a local-first AI documents assistant that lets you securely index and chat with thousands of desktop documents with zero cloud leakage.
The most advanced, fully offline client-side AI suite on Android today.
MemoryCache is an experimental development project to turn a local desktop environment into an on-device AI agent
A desktop app for running Large Language Models locally.
Orchestrate an entire AI dev team on 5GB VRAM. Ephemeral subagents, exact-match diffs. Single static binary, any model. Zero config, zero context bloat.
QVAC - Local AI SDK and libraries for building private, cross-platform, peer-to-peer AI applications. Run LLMs, speech-to-text, translation, and more locally on Linux, macOS, Windows, Android, and iOS.
High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.
Local RAG MCP server for Claude Code β hybrid search (semantic + BM25), cross-encoder reranking, 13 MCP tools, 20 format parsers. Zero external servers, zero API keys.
Complete guide to running large language models locally on AMD Strix Halo / Ryzen AI MAX+ 395 with Radeon 8060S (gfx1151) and 96GB/128GB unified memory. Covers BIOS config, Ubuntu/kernel setup, Ollama, llama.cpp Vulkan/RADV, ROCm/HIP, vLLM, and 70B/120B GGUF evidence.
Private on-device AI chat for Android β runs any GGUF model locally via llama.cpp with ARM-optimised SIMD. Zero network permissions, encrypted settings, biometric lock, tamper detection.
Free open-source Screenpipe GUI + macOS automation agent. Search your screen history, view analytics, automate workflows β all local, no cloud. Works with the free Screenpipe CLI.
Plug-and-play homelab dashboard in one container β GPU, local-AI VRAM, Docker, systemd, host health. Built-in read-only MCP server so AI agents can explore it too.
Memory that learns what works.
The self-hosted AI workstation. Autonomous screen agents, 3-tier neural routing, parallel agent swarms, video generation, 4K/8K upscaling, RAG, voice interface, 70+ tool execution engine β all running locally on your hardware.
Free local AI client for DeepSeek, Qwen and ChatGPT with OpenAI-compatible API, CLI, code agent, memory and skills.
lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)
Deploy a complete self-hosted AI stack with Docker Compose: Ollama, LiteLLM, AnythingLLM, Whisper, WhisperLive, Kokoro, Embeddings, Docling and MCP Gateway. Local-first, private by default, with lightweight stacks, optional HTTPS and NVIDIA CUDA acceleration. Multi-arch: amd64, arm64.
A Living Library You Can Talk To. Open-source educational platform with 30 historical figures from philosophy, science, art, mysticism, and activism. Stories, dialogues, AI conversation, multi-figure councils. Nonprofit, BYOK, self-hostable, no behavioral tracking.
AgC is the open-core platform that powers Open Agentic Compute β a new compute substrate purpose-built for deploying, running, and orchestrating AI agents at scale.
A Full-Featured, Powerful & Ultra-lightweight, video player for Windows with on-device AI powered subtitle generation. Tauri + Svelte
Open-Source Intelligent Command Layer
A complete private computer on a USB stick. PAI is a bootable Debian 12 Linux distro that runs Ollama locally on any x86_64 or ARM64 machine β full desktop, local AI, hardened networking, all in RAM. Plug in, boot in seconds, work anywhere, pull the stick and nothing stays behind. Your AI on your hardware, no cloud, no accounts. https://pai.direct
VS Code Extension for the Pi Agent.
Lilium AI: The ultimate personal AI agent framework for autonomous computer control. Featuring browser automation, shell execution, and multi-channel integration (WeChat/Telegram/Discord).
π€ AI-powered macOS automation framework - Control your Mac with natural language using GPT models. No code needed, just English instructions!
A personal AI agent that can work safely on your machine, remember useful context, and keep its data under your control.
A high performance C++ SDK for AI Agents
Fully local voice AI for iOS
A fast terminal native app (TUI) and CLI with init wizard for launching local LLMs with zero overhead
AI inference, packed simply. A blazing-fast, zero-dependency WebGPU runtime to run GGUF models directly in the browser. Features a symmetric API for seamless local execution and cloud provider routing. Built with Rust & C++.
Intelligent Cost-Optimizing Model Router for OpenClaw
YouLama is a web application that allows users to generate summaries or easy to read transcripts of YouTube videos using AI-powered language models.
MemGallery: A smart memory bank to store all your memories from audio, images, text, and URLs. AI-indexed (local or provided), on-device, no cloud, and no sign-up required.
API Keys made beautiful