#Npu
Showing 16 of 16 repositories tagged #npu, ranked by stars
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
Tengine is a lite, high performance, modular inference engine for embedded device
Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.
A Lighting Pytorch Framework for Recommendation Models, Easy-to-use and Easy-to-extend.
Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )
Universal Virtualization Management Platform 可扩展的通用虚拟化管理平台，支持 Proxmox VE / LXD (GPU) / Incus (GPU) / Docker / Podman / Containerd / Qemu / Kubevirt
Samples code for world class Artificial Intelligence SoCs for computer vision applications.
PyTorchSim is a Comprehensive, Fast, and Accurate NPU Simulation Framework
YoloV8 NPU for the RK3566/68/88
This repo is used for archiving my notes, codes and materials of cs learning.
将LLM 模型部署到 Rockchip Rk3588芯片中，在开发板上使用NPU进行推理
Real-time YOLOv8n UAV detection on the RK3588S NPU | saturates the sensor at 46 FPS | ~140 MB RAM | fully hardware-accelerated (ISP+RGA+NPU) | on-device LLM scene summaries
Simplified AI runtime integration for mobile app development
Perplexity style AI answer engine for AI PCs with CPU,GPU and NPU support
Official repo for Windows ML - Microsoft's high-performance local AI inferencing framework for Windows.