#Tensorrt
Showing 60 of 65 repositories tagged #tensorrt, ranked by stars
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/
Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.
BoxMOT: Pluggable python and c++ SOTA multi-object tracking modules with support for axis-aligned and oriented bounding boxes
📄 Awesome OCR multiple programing languages toolkits based on ONNX Runtime, OpenVINO, MNN, PaddlePaddle, TensorRT and PyTorch.
TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.
《Pytorch实用教程》（第二版）无论是零基础入门，还是CV、NLP、LLM项目应用，或是进阶工程化部署落地，在这里都有。相信在本书的帮助下，读者将能够轻松掌握 PyTorch 的使用，成为一名优秀的深度学习工程师。
Tengine is a lite, high performance, modular inference engine for embedded device
Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
DAMO-YOLO: a fast and accurate object detection method with some new techs, including NAS backbones, efficient RepGFPN, ZeroHead, AlignedOTA, and distillation enhancement.
OpenMMLab Model Deployment Framework
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
C++ library based on tensorrt integration
computer vision projects | 计算机视觉相关好玩的AI项目（Python、C++、embedded system）
Deep Learning Server and CLI for Torch and TensorRT
Turn any computer or edge device into a command center for your computer vision projects.
YOLOv4, YOLOv4-tiny, YOLOv3, YOLOv3-tiny Implemented in Tensorflow 2.0, Android. Convert YOLO v4 .weights tensorflow, tensorrt and tflite
🚀 Easier & Faster YOLO Deployment Toolkit for NVIDIA 🛠️
一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework
🚀🚀🚀 A collection of some awesome public YOLO object detection series projects and the related object detection datasets.
Deep learning gateway on Raspberry Pi and other edge devices
Library for Fast and Flexible Human Pose Estimation
High-performance multiple object tracking based on YOLO, Deep SORT, and KLT 🚀
Aim-bot based on AI for all FPS games
Stable diffusion webui based on diffusers.
Jetson Nano with Ubuntu 20.04 image
PytorchAutoDrive: Segmentation models (ERFNet, ENet, DeepLab, FCN...) and Lane detection models (SCNN, RESA, LSTR, LaneATT, BézierLaneNet...) based on PyTorch with fast training, visualization, benchmarking & deployment help
Fast and accurate object detection with end-to-end GPU optimization
从 NLP 到 LLM 的算法全栈教程，在线阅读地址：https://datawhalechina.github.io/base-llm/
Python Computer Vision & Video Analytics Framework With Batteries Included
Video Frame Interpolation & Super Resolution using NVIDIA's TensorRT & Tencent's NCNN inference, beautifully crafted and packaged into a single app
Adlik: Toolkit for Accelerating Deep Learning Inference
TensorRT C++ API Tutorial
YoloDotNet - A C# .NET 8.0 project for Classification, Object Detection, OBB Detection, Segmentation and Pose Estimation in both images and live video streams.
Deploy your model with TensorRT quickly.
YOLOv8 TensorRT C++ Implementation
yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.
TensorFlow models accelerated with NVIDIA TensorRT
基于深度学习的肿瘤辅助诊断系统，以图像分割为核心，利用人工智能完成肿瘤区域的识别勾画并提供肿瘤区域的特征来辅助医生进行诊断。有完整的模型构建、后端架设、工业级部署和前端访问功能。TensorRT、PyTorch 、OpenCV 、Flask、Vue
InsightFace REST API for easy deployment of face recognition services with TensorRT in Docker.
An Optimized Speech-to-Text Pipeline for the Whisper Model Supporting Multiple Inference Engine
Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. Join our Discord communty: https://discord.com/invite/TgHXuSJEk6
A library for high performance deep learning inference on NVIDIA GPUs.
This repo is implemented based on detectron2 and centernet
an edge-real-time anchor-free object detector with decent performance
🚀🚀🚀 This repository lists some awesome public CUDA, cuda-python, cuBLAS, cuDNN, CUTLASS, TensorRT, TensorRT-LLM, Triton, TVM, MLIR, PTX and High Performance Computing (HPC) projects.
Efficient CPU/GPU ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE, SCUNet, ArtCNN and more!)
Fast GPU OCR server. 270 img/s on FUNSD. TensorRT FP16, PP-OCRv5, HTTP + gRPC.
This is a DeepStream application to demonstrate a human pose estimation pipeline.
Easy and fast 2d human and animal multi pose estimation using SOTA ViTPose [Y. Xu et al., 2022] Real-time performances and multiple skeletons supported.
Beginner's Guide to reComputer Jetson
Deep Learning Benchmarking Suite
Predict live chess games into FEN notation.
Computer Vision deployment tools for dummies and experts. CVU aims at making CV pipelines easier to build and consistent around platforms, devices, and models.
ONNX-compatible DeDoDe 🎶 Detect, Don't Describe - Describe, Don't Detect, for Local Feature Matching. Supports TensorRT 🚀
Speed up image preprocess with cuda when handle image or tensorrt inference
Valorant Models in Yolov5 and Yolov7
A library for training, compressing and deploying computer vision models (including ViT) with edge devices
FastCrest Tether: the OSS edge-to-cloud AI deploy CLI. Optimize, verify, deploy across Jetson, RTX, Apple Silicon, AMD. Hybrid edge-cloud inference with parity certs.
Chat With RTX Python API