#Onnxruntime
Showing 60 of 63 repositories tagged #onnxruntime, ranked by stars
Lightning-Fast, On-Device, Multilingual TTS โ running natively via ONNX.
Open source real-time translation app for Android that runs locally
Effortless data labeling with AI support from Segment Anything and other awesome models.
Silero VAD: pre-trained enterprise-grade Voice Activity Detector
๐ Awesome OCR multiple programing languages toolkits based on ONNX Runtime, OpenVINO, MNN, PaddlePaddle, TensorRT and PyTorch.
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
An Engine-Agnostic Deep Learning Framework in Java
An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.
OpenMMLab Model Deployment Framework
QualityScaler - image/video AI upscaler app
Fast ML inference & training for ONNX models in Rust
Voice activity detector (VAD) for the browser with a simple API
ไธๆฌพ็ฎๅๆ็จๅ้ซๆง่ฝ็AI้จ็ฝฒๆกๆถ | An Easy-to-Use and High-Performance AI Deployment Framework
An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.
ๆฏๆๆ่ฝดๅนๆปๅๆ, ๆ ็ผๅถ้ ไธ่งฃ, ็จไบๅฎ็ฐ่่ๆกฃๆก่ชๅจๅ็็จๅบ( Steamๅทฒ้้ )
Realtime human head pose estimation with ONNXRuntime and OpenCV.
Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust ๐ฆ
A Redis module for serving tensors and executing deep learning graphs
AI Productivity Tool - Free and open source, improve user productivity, and protect privacy and data security. Including but not limited to: built-in local exclusive ChatGPT, DeepSeek, Phi, Qwen and other models, one-click batch intelligent processing of pictures, videos, audio, etc.
yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.
Fast Automatic License Plate Recognition (ALPR) framework.
A Go (golang) library wrapping microsoft/onnxruntime.
Lightweight & fast OCR models for license plate text recognition.
โก boost inference speed of T5 models by 5x & reduce the model size by 3x.
Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. Join our Discord communty: https://discord.com/invite/TgHXuSJEk6
Python scripts performing object detection using the YOLOv8 model in ONNX.
Search and organise images and videos offline with on-device AI.
Efficient CPU/GPU ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE, SCUNet, ArtCNN and more!)
a GUI application, which uses YOLOs (YOLOv8, YOLO11, YOLOv13) for Object Detection/Tracking, Human Pose Estimation/Tracking from images, videos or camera
LLaMa/RWKV onnx models, quantization and testcase
ONNX runtime for Flutter.
Python scripts for the Segment Anythin 2 (SAM2) model in ONNX
It is a simple library to speed up CLIP inference up to 3x (K80 GPU)
an architecture for neural network inference in real-time audio applications
High accurate text detection (OCR) Javascript/Typescript library that runs on Node.js, Browser, React Native and C++. Based on PaddleOCR and ONNX runtime
ONNX Runtime Server: The ONNX Runtime Server is a server that provides TCP and HTTP/HTTPS REST APIs for ONNX inference.
Neural network inference template for real-time cricital audio environments - presented at ADC23
State-of-the-art face detection and face recognition for .NET.
Lightweight, probably the fastest PaddleOCR SDK in TypeScript. Multilingual Support. Runs anywhere JavaScript runs: Node.js, Bun, Deno, mobile react-native, web browsers, and browser extensions. Docker & CLI supported. The official SDK is browser-only.
ไฝฟ็จONNXRuntime้จ็ฝฒPaddleOCR-v3, ๅ ๅซC++ๅPythonไธคไธช็ๆฌ็็จๅบ
An OCR App for Manga
Python scripts performing Metric Monocular Depth Estimation using the Unidepth model in ONNX.
Predict live chess games into FEN notation.
Computer Vision deployment tools for dummies and experts. CVU aims at making CV pipelines easier to build and consistent around platforms, devices, and models.
ONNX-compatible DeDoDe ๐ถ Detect, Don't Describe - Describe, Don't Detect, for Local Feature Matching. Supports TensorRT ๐
Face Anti-Spoofing project. Lanit-Tercom summer school 2022
A project to demonstrate an approach to designing cross-language and distributed pipeline in deep learning/machine learning domain, using WebRTC and Redis Streams.
high-speed, high-accuracy, local ocr for japanese video games
Example of transformers.js on React Native
Python scripts for performing 6D pose estimation and shape reconstruction using the CenterSnap model in ONNX
buildseg is a building extraction plugin of QGIS based on ONNXใbuildsegๆฏไธไธชๅบไบONNX็็จไบๅปบ็ญๆๅ็QGISๆไปถใ
An easy to use C# open source image labeler for YOLO with AI auto label abilities via YOLO/Onnx models.
Python scripts for performing road segemtnation and car detection using the HybridNets multitask model in ONNX.
TOnnxRuntime is a Microsoft ONNXRuntime AI and Machine Learning Library for Freepascal / Delphi
OpenVitamin is a local-first AI execution platform that unifies Agents, Workflows, and multi-model inference into a single programmable system โ designed for building real, production-grade AI applications.
On Device Stable Diffusion In Mobile Devices
Python scripts performing Open Vocabulary Object Detection using the YOLO-World model in ONNX.
pg_onnx: ONNX Runtime integrated with PostgreSQL. Perform ML inference with data in your database.
Goink ๆก้ข AI ๅฐ่ฏดๅไฝๅฉๆ๏ผๅฏน่ฏๅผๅไฝ + ่ชๅจ็ถๆ่ฟฝ่ธช + ๆฌๅฐ่ฏญไนๆ็ดขใ่ทจๅนณๅฐๅผ็ฎฑๅณ็จใAI Agent Novel Generator.
Full-attention multi-instrumental music transformer featuring asymmetrical encoding with octo-velocity, and chords counters tokens, optimized for speed and performance