#Pipeline
Showing 60 of 234 repositories tagged #pipeline, ranked by stars
Event Driven Orchestration & Scheduling Platform for Mission Critical Applications
Declarative Continuous Deployment for Kubernetes
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
☁️ Build multimodal AI applications with cloud-native stack
A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Turns Data and AI algorithms into production-ready web applications in no time.
Always know what to expect from your data.
PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement
httpx is a fast and multi-purpose HTTP toolkit that allows running multiple probes using the retryablehttp library.
Install Jenkins, configure Docker as slave, set up cicd, deploy applications to k8s using Argo CD in GitOps way.
A cloud-native Pipeline resource.
🧙 Build, run, and manage data pipelines for integrating and transforming data.
📚 Parameterize, execute, and analyze notebooks
最全面的游戏开发技术图谱(Game Development Map)。帮助游戏开发者们在已知问题上节省时间，省出更多的精力投入到更有创造性的工作中去。
Build powerful pipelines in any programming language.
cube studio开源云原生一站式机器学习/深度学习/大模型AI平台，mlops算法链路全流程，算力租赁平台，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU虚拟化，边缘计算，标注平台自动化标注，deepseek等大模型sft微调/奖励模型/强化学习训练，vllm/ollama/mindie大模型多机推理，私有知识库，AI模型市场，支持国产cpu/gpu/npu 昇腾生态，支持RDMA，支持pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/ray/volcano等分布式
AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation
Jenkins X provides automated CI+CD for Kubernetes with Preview Environments on Pull Requests using Cloud Native pipelines from Tekton
A guideline for building practical production-level deep learning systems to be deployed in real world applications.
Machine Learning Pipelines for Kubeflow
Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
A DSL for data-driven computational pipelines
Blender addons that improve the game development workflow between Blender and Unreal.
SaaS Boilerplate - Open Source and free SaaS stack that lets you build SaaS products faster in React, Django and AWS. Focus on essential business logic instead of coding repeatable features!
Kubernetes-native platform to run massively parallel data/streaming jobs
Machine learning platform for Web developers
HuixiangDou: Overcoming Group Chat Scenarios with LLM-based Technical Assistance
🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications
QuantMind is an intelligent knowledge extraction and retrieval framework for quantitative finance.
A Julia machine learning framework
Go toolkit for clean, composable, channel-based concurrency
For extensive instructor led learning
[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.
System for containerized apps management. From build to scaling.
PyTorch extensions for fast R&D prototyping and Kaggle farming
MLBox is a powerful Automated Machine Learning python library.
a realtime plotting utility for terminal/console with data input from stdin
An R-focused pipeline toolkit for reproducibility and high-performance computing
Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀
Connect processes into powerful data pipelines with a simple git-like filesystem interface
Modern SeaTunnel Web UI with visual DAG pipelines, batch & streaming sync, connector management, built-in metrics, and runtime logs.
Function-oriented Make-like declarative workflows for R
A curated collection of publicly available resources on how companies around the world practice DevOps
An open-source ML pipeline development platform
Tiny automation pipelines. Bring CI/CD to the smallest projects. Self-hosted, Lightweight, CLI only.
A full-stack DevOps on AWS framework
An n:m message multiplexer written in Go
A WDL, CWL and Python API supporting easy-to-use workflow engine. It is scalable, efficient and cross-platform (Linux/macOS).
LAMA - automatic model creation framework
A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）
Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.
🪿 LinGoose is a Go framework for building awesome AI/LLM applications.
Notebooks, code samples, sample apps, and other resources that demonstrate how to use, develop and manage machine learning and generative AI workflows using Google Cloud Vertex AI.
Plumber detects CI/CD security issues in your GitHub workflows and gives you a score
A library adding some anti-Pythonic syntatic sugar to Python
Easy pipelines for pandas DataFrames.
Declarative language for composable Al workflows. Devtool for agents and mere humans.
🏎️ Streams & Reactive Programming paradigm for Go: declarative and composable API for event-driven applications
Python task scheduler with a user-friendly web UI