#Dataflow
Showing 39 of 39 repositories tagged #dataflow, ranked by stars
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.
Simple flow library 🖥️🖱️
DORA (Dataflow-Oriented Robotic Architecture) is middleware designed to streamline and simplify the creation of AI-based robotic applications. It offers low latency, composable, and distributed dataflow capabilities. Applications are modeled as directed graphs, also referred to as pipelines.
A DSL for data-driven computational pipelines
Flowistry is an IDE plugin for Rust that helps you focus on relevant code.
Code security scanning tool (SAST) to discover, filter and prioritize security and privacy risks.
A Static Analysis Tool for Detecting Security Vulnerabilities in Python Web Applications
Python Stream Processing
Flow-based and dataflow programming library for Go (golang)
React to any event with serverless functions across clouds
A reactive Python kernel for Jupyter notebooks.
Dataflow compiler for QNN inference on FPGAs
Workflows and interfaces for neuroimaging packages
Experimental visual Go environment
A convenient Python wrapper for Apache NiFi
Explore the energy-efficient dataflow scheduling for neural networks.
JavaScript dataflow graph editor
Streaming Anomaly Detection Solution by using Pub/Sub, Dataflow, BQML & Cloud DLP
Blocks. An online drag-and-drop smart contract builder.
Web-based Dataflow Framework for Visual Data Exploration
Project demonstrating how to automate Prefect 2.0 deployments to AWS ECS Fargate
Example repository showing how to build a data platform with Prefect, dbt and Snowflake
Code examples showing flow deployment to various types of infrastructure
A lightweight (serverless) native python parallel processing framework based on simple decorators and call graphs.
A Lightweight, Cloud-Native Stateful Distributed Dataflow Engine
A helper tool to design CG Pipeline interactive diagrams and data flow documentation
Reactive Network of Operators In Rust. Framework for Parallel and distributed computation inspired from the DataFlow model
High-performance, multi-platform, type-safe programming language designed for visual & AI assisted development
End-to-end DataOps platform deployed by Terraform.
Example project demonstrating deployment patterns for real-time streaming workflows with Prefect 2.0
The Dataflow Solution Guides offer full end-to-end deployment for the most common streaming solutions to run on Dataflow.
Slipstream provides a data-flow model to simplify development of stateful streaming applications.
This project leverages GCS, Composer, Dataflow, BigQuery, and Looker on Google Cloud Platform (GCP) to build a robust data engineering solution for processing, storing, and reporting daily transaction data in the online food delivery industry.
Deploy a Prefect flow to serverless AWS Lambda function
Integrates LLMs as PTransform in Apache Beam pipelines using LangChain
An inter-language runtime for flow-based programming (FBP)
Efficient streaming data ingestion, transformation & activation
End-to-end ELT data engineering project