#Mlx
Showing 60 of 62 repositories tagged #mlx, ranked by stars
Hundreds of models & providers. One command to find what runs on your hardware.
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)
Examples in the MLX framework
A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.
Own your AI. The native macOS harness for AI agents -- any model, persistent memory, autonomous execution, cryptographic identity. Built in Swift. Fully offline. Open source.
Run LLMs with MLX
MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
Local-first healthcare AI: clinical NER & HIPAA PII de-identification that runs 100% on-device. 1,000+ medical models, 12 languages, Apple MLX + Python, no cloud, no patient data leaving your network. Apache-2.0
The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider.
MLX native implementations of state-of-the-art generative image models
A native macOS AI chat app powered by MLX. 100% local inference on Apple Silicon, no cloud required. Built with ShipSwift.
Magenta RealTime 2: An Open-Weights Live Music Model
OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models (Llama, Qwen-VL, LLaVA) with continuous batching, MCP tool calling, and multimodal support. Native MLX backend, 400+ tok/s. Works with Claude Code.
Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.
Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer.
AirPods as posture coach
AI speech toolkit for Apple Silicon — ASR, TTS, speech-to-speech, VAD, and diarization powered by MLX and CoreML
Bonsai Demo
MLX Studio - Home of JANG_Q - Image Gen/Edit + Chat/Code All in one - + OpenClaw (Anthropic API)
🤖✨ChatMLX is a modern, open-source, high-performance chat application for MacOS based on large language models.
vMLX - JANGTQ Uber Compressed MLX Models - L2 Disk Cache (survives restart) + L1 Paged (super fast ttft) + Hybrid SSM Scheduler + Cont Batching + etc!
⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.
Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking
A fully local and private Speech-To-Text app with cross-platform support, speaker diarization, Audio Notebook mode, LM Studio integration, and both longform and live transcription.
Node Creative Coding / 3D / Image Processing tool inspired by Quartz Composer
On-device meeting capture, dictation, and vault-native knowledge layer for macOS. Nothing leaves your Mac.
Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.
The open creative AI workspace
Vocello — a local, private voice studio for Apple Silicon. Write a script, pick or describe a voice, and generate speech on-device. macOS today, iPhone coming soon. (Formerly QwenVoice.)
PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal acceleration.
The production framework for Predictive and Generative AI. Serve any model as an API in one line, with OpenAI/Anthropic/Ollama-compatible endpoints, a built-in chat UI, and native MCP.
AI Copilot for Vim/NeoVim
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mode, and tool calling.
High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.
A native Mac App for LLM fine-tuning on Apple Silicon — fully on-device, fully open source.
JANG — GGUF for MLX. YOU MUST USE JANG_Q RUNTIME. Adaptive Mixed-Precision Quantization + Runtime for Apple Silicon
Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU, autoscaling, air-gapped, production-ready.
Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
Synthetic Autonomic Mind - An AI assistant for everyone.
Tool calling using MLX Swift across iOS, macOS, and visionOS platforms
Flash weight streaming for MLX: run massive models larger than your RAM on Apple Silicon.
Open-Source Intelligent Command Layer
Eris is a private AI chat application that runs entirely on your device using Apple's MLX framework. Named after the dwarf planet that challenged our understanding of the solar system, Eris challenges the notion that AI must live in the cloud.
Implementation of F5-TTS in Swift using MLX
Pure MLX implementations of UMAP, t-SNE, PaCMAP, TriMap, DREAMS, CNE, MMAE, and NNDescent for Apple Silicon. Metal GPU for computation and video rendering.
Ultra-Sparse Adaptation of 1-Bit LLMs via XOR Patches
Local image and music generation for Apple Silicon
AI-Powered Autonomous Binary Reverse Engineering CLI — the native reverse engine from Innora-Sentinel. Local LLM inference (MLX), MPS GPU acceleration, multi-round iterative analysis, zero API cost.
Native macOS system cleaner with YAML-driven safety rules, local AI explainability via MLX, and an MCP server for agent-controlled cleanup workflows.
Your computer was paying attention the whole time. 14-modality capture. Proactive intelligence. Computer-use training data. Native macOS. All on-device. Open source.
Cactus Flutter plugin: Run AI locally in your Flutter apps
Build an Autonomous Web3 AI Trading Agent (BASE + Uniswap V4 example)
Train your own ChatGPT on Apple Silicon — MLX port of nanochat
◉ Universal Intelligence: AI made simple.
Airgapped closed-corpus QA loop: a self-hosted Qwen3.6 agent explores a .zip dataroom under a token budget with local tools
Toy-scale unified multimodal model experiments — encoder-free understanding & generation with Mixture-of-Transformers on MLX/Apple Silicon
UMAP in pure MLX for Apple Silicon. 30x faster than umap-learn.
Build a GPT from scratch, one concept at a time, from pure Python to PyTorch, JAX, MLX, and production serving. Inspired by Andrej Karpathy's microGPT.
macOS voice productivity app — built-in dictation, AI rewrite, and translation. Powered by local Whisper + LLM.