#Stream-processing
Showing 60 of 68 repositories tagged #stream-processing, ranked by stars
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Cross-platform, customizable ML solutions for live and streaming media.
A high-performance observability data pipeline.
A curated list of awesome big data frameworks, ressources and other awesomeness.
Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
Building event-driven applications the easy way in Go.
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Fancy stream processing made operationally mundane
Python Stream Processing
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
๐ Online machine learning in Python
FastStream is an asynchronous Python framework for building event-driven applications. It brings together message broker integration, dependency injection, validation, testing utilities, and AsyncAPI documentation generation in a single toolkit
๐ฆ event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
Danfo.js is an open source, JavaScript library providing high performance, intuitive, and easy to use data structures for manipulating and processing structured data.
Distributed stream processing engine in Rust
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
Kubernetes-native platform to run massively parallel data/streaming jobs
high performance JSON encoder/decoder with stream API for Golang
Python Stream Processing
๐ฆญ Distributed log streaming engine built from first principles
A Python stream processing engine modeled after Yahoo! Pipes
Stream Processing and Complex Event Processing Engine
Python Streaming DataFrames for Kafka
Distributed Stream Processing
A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes
Framework for building Event-Driven Microservices
An open-source computer vision framework to build and deploy apps in minutes
A stream processing API for Go (now with generic type support)
Build platforms that flexibly mix SQL, batch, and stream processing paradigms
Low-code tool for automating actions on real time data | Stream processing for the users.
Play any radios around the globe right from the terminal :zap:
Platform for Situated Intelligence
Harmonious distributed data analysis in Rust.
Log Anomaly Detection - Machine learning to detect abnormal events logs
A real-time interactive web app based on data pipelines using streaming Twitter data, automated sentiment analysis, and MySQL&PostgreSQL database (Deployed on Heroku)
head/tail for structured data - summarize/preview JSON/YAML and source code
graph based stream processing framework
A Go port of the Java Streams API. Type-safe and functional Go Streams processing
๐ง A curated list of OLAP databases, data lake tools, columnar engines, and analytics frameworks for data engineers.
Kafka data generator and load testing tool - generate fake messages, simulate producers and consumers, test broker failures, and run chaos engineering scenarios
A stream processing runtime that allows connecting any streaming data source to any destination and act on it
A high-throughput, consistent ticket reservation system that can process 83000+ reservations per second
High-performance streaming SQL query engine designed for real-time data processing. Use cases include event-driven architectures, ETL pipelines, and modern data-intensive applications.
๐จ Simple, self-contained fraud detection system built with Apache Kafka and Python
Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes
Scramjet Transform Hub (STH) is a runtime supervisor that can run data processing programs called Sequences and manage local resources on any Linux server, Docker on small edge servers, and even large-scale Kubernetes clusters in the cloud or datacenters. It connects to Scramjet Spaces in Scramjet Cloud Platform.
Examples for using Apache Flinkยฎ with DataStream API, Table API, Flink SQL and connectors such as MySQL, JDBC, CDC, Kafka.
Apache Flink Guide
Example projects and demos around data streaming , stream processing, change data capture, and more.
Agentic Data Integrator that helps you build production-ready data pipelines so you can connect to more systems, faster. You run it in your terminal as a workflow wizard.
Theodolite is a framework for benchmarking the horizontal and vertical scalability of cloud-native applications.
a payment application intended for deployment by the united states treasury that replaces banking with accounting
A SPARQL database, RDF Stream Processing Engine and RDF toolkit, supporting Neurosymbolic Stream Reasoning
FORMCEPT Whiteboard used by developers for developers
A Kubernetes Operator to orchestrate Benthos pipelines
Python stream processing for analytics
Table-Computing (Simplified as TC) is a high performance and low latency computing framework, 10x faster than Flink for complicated use cases, distributed and light weighted, relational operation, simple to use, write less and do more.
Slipstream provides a data-flow model to simplify development of stateful streaming applications.
Utility functions and base classes for Kafka Streams applications
ๆบ่ฝๆฐๆฎๆข็ดขๆๅก(Intelligent Data Exploration Service)๏ผไธ็ซๅผData + AIๆฐๆฎ่งฃๅณๆนๆก๏ผ