#Inference-api

Showing 10 of 10 repositories tagged #inference-api, ranked by stars

roboflow
roboflow
inference

Turn any computer or edge device into a command center for your computer vision projects.

Score
0
★ 2.4k ⑂ 287 +1/day
Python
basetenlabs
basetenlabs
truss

The simplest way to serve AI/ML models in production

Score
67
★ 1.2k ⑂ 111
Python
qualcomm
qualcomm
ai-hub-models

Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

Score
100
★ 1.2k ⑂ 207 +1/day
Python
qualcomm
qualcomm
ai-hub-apps

The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

Score
33
★ 432 ⑂ 110 +3/day
Python
inference-gateway
inference-gateway
inference-gateway

An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.

Score
100
★ 130 ⑂ 21
Go
avilum
avilum
minrlm

A small Recursive Language Model: let any LLM run code on its context instead of stuffing it into the prompt.

Score
100
★ 72 ⑂ 5 +1/day
Python
BMW-InnovationLab
BMW-InnovationLab
BMW-Classification-Training-GUI

This repository allows you to get started with training a State-of-the-art Deep Learning model with little to no configuration needed! You provide your labeled dataset and you can start the training right away. You can even test your model with our built-in Inference REST API. Training classification models with GluonCV has never been so easy.

Score
0
★ 71 ⑂ 2
Python
intelligencedev
intelligencedev
eternal

Eternal is an experimental platform for machine learning models and workflows.

Score
0
★ 70 ⑂ 5
Go
decisionfacts
decisionfacts
semantic-ai

An open source framework for Retrieval-Augmented System (RAG) uses semantic search helps to retrieve the expected results and generate human readable conversational response with the help of LLM (Large Language Model).

Score
50
★ 22 ⑂ 1
Python
RageAgainstThePixel
RageAgainstThePixel
com.rest.huggingface

A Non-Official HuggingFace Rest Client for Unity (UPM)

Score
0
★ 17 ⑂ 1
C#
Related Topics
#machine-learning#inference#onnx#inference-engine#llm#classification#computer-vision#inference-server#stable-diffusion#deeplearning#demos#machinelearning

© 2026 GitRepoTrend · GitHub repositories by topic · Updated weekly