#Pipelines
Showing 60 of 85 repositories tagged #pipelines, ranked by stars
A high-performance observability data pipeline.
Turns Data and AI algorithms into production-ready web applications in no time.
Workflow Engine for Kubernetes
π§ Build, run, and manage data pipelines for integrating and transforming data.
Concourse is a container-based automation system written in Go. It's mostly used for CI/CD.
ZenML π: One AI Platform from Pipelines to Agents. https://zenml.io.
Build data pipelines, the easy way π οΈ
AI Infra / AI Orchestration / AI Control Plane
The fastest β‘οΈ way to build data pipelines. Develop iteratively, deploy anywhere. βοΈ
Event-driven Automation Framework for Kubernetes
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
TransmogrifAI (pronounced trΔns-mΕgΛrΙ-fΔ«) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning
Elyra extends JupyterLab with an AI centric approach.
A Julia machine learning framework
Un repositorio mΓ‘s con conceptos bΓ‘sicos, desafΓos tΓ©cnicos y recursos sobre ingenierΓa de datos en espaΓ±ol π§β¨
Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.
Azure AKS Kubernetes Masterclass
Framework for large distributed pipelines
Tenzir is the data pipeline engine for security teams.
A C-like hardware description language (HDL) adding high level synthesis(HLS)-like automatic pipelining as a language construct/compiler feature.
The open source, end-to-end computer vision platform. Label, build, train, tune, deploy and automate in a unified platform that runs on any cloud and on-premises.
Azure DevOps Extension for Azure CLI
pypyr task-runner cli & api for automation pipelines. Automate anything by combining commands, different scripts in different languages & applications into one pipeline process.
π¦ Test your Gitlab CI Pipelines changes locally using Docker.
Platform for Situated Intelligence
Zero-copy I/O primitives and pipelines for Go. Linux-specific.
TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.
Dataplane is an Airflow inspired unified data platform with additional data mesh and RPA capability to automate, schedule and design data pipelines and workflows. Dataplane is written in Golang with a React front end.
Use SQL to build ELT pipelines on a data lakehouse.
Classification of Breast Cancer diagnosis Using Support Vector Machines
Tangle is a web app that allows the users to build and run Machine Learning pipelines without having to set up development environment.
Simplifying the definition and execution, scaling and deployment of pipelines on the cloud.
Repository maintained by AZ-400 course and Learn content community. Project used for AZ-400 Labs. Forked from: https://github.com/dotnet-architecture/eShopOnWeb Sample - ASP.NET Core 8.0 reference application, powered by Microsoft, demonstrating a layered application architecture with monolithic deployment model.
Toloka-Kit is a Python library for working with Toloka API.
A cross tenant metadata driven processing framework for Azure Data Factory and Azure Synapse Analytics achieved by coupling orchestration pipelines with a SQL database and a set of Azure Functions.
Azure DevOps Mobile App
Integrated CI/CD Solution for Microsoft Azure
The open core .NET job orchestrator that we've been missing
Dataflow Programming for Machine Learning in R
Pipeline is an open source python SDK for building AI/ML workflows
A Deep Learning and preprocessing framework in Rust with support for CPU and GPU.
Transforms and pipelines with tabular data in Julia
Data pipelines from re-usable components
Continuous Integration Tool for Swift Projects
A service that bridges traditional pipelines and GitOps, improving deployment visibility. Includes a built-in GitOps repo updater.
Get started with Tekton Pipelines :smiley_cat: for https://dn.dev/master. Learn from basics to advanced
Service for quick deploying and using dockerized Computer Vision models
Collective Knowledge components for TensorFlow (code, data sets, models, packages, workflows):
π Examples of how to use Neptune for different use cases and with various MLOps tools
π΅ Gee is tool of stdin to each files and stdout. It is similar to the tee command, but there are more functions for convenience. In addition, it was written as go
Connectome Mapper 3 is a BIDS App that implements full anatomical, diffusion, resting/state functional MRI, and recently EEG processing pipelines, from raw T1 / DWI / BOLD , and preprocessed EEG data to multi-resolution brain parcellation with corresponding connection matrices.
Samples for Github Actions DevOps pipelines and workflows
Security considerations and guidelines for Azure DevOps and Azure
Vent is a light-weight platform built to automate network collection and analysis pipelines using a flexible set of popular open source tools and technologies. Vent is python-based, extensible, leverages docker containers, and provides both an API and CLI.
Gitlab CI Dashboard will provide you a global overview of all pipelines, schedules and their status within a single group
The REST API and execution engine for the Didact Platform.
Bank customers churn dashboard with predictions from several machine learning models.
API .NET para gerenciamento de receitas com login via Google e integração com ChatGPT. Utiliza arquitetura DDD e SOLID. Testes unitÑrios e de integração implementados. Mensageria e deploy com Azure.
This repository provides resources and guidelines to facilitate the integration of Open-WebUI and Langfuse, enabling seamless monitoring and management of AI model usage statistics.
Demonstration of a Kubernetes-centric CI/CD workflow