#Ai-inference

bentoml

BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

uxlfoundation

scikit-learn-intelex

Extension for Scikit-learn is a seamless way to speed up your Scikit-learn application

uxlfoundation

oneDAL

oneAPI Data Analytics Library (oneDAL)

arm-education

AI-on-Arm

Hands-on course materials for deploying and optimizing generative AI on Arm processors: Raspberry Pi, AWS Graviton, SIMD, quantization (educational)

vienneraphael

batchling

Save 50% off GenAI costs in two lines of code