#Apache-kafka
Showing 42 of 42 repositories tagged #apache-kafka, ranked by stars
Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining visibility into your topics, masking data, managing consumer groups, and exploring real-time data with time-travel debugging.
🦭 Distributed log streaming engine built from first principles
Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning
Command Line Tool for managing Apache Kafka
Kafka command line tool that likes JSON
Kafka-based Job Queue for Python
Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition
:rocket: Web GUI for Kafka Cluster Management
A modern and intuitive command line client for Kafka Connect
An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.
The Open source Resource as Code framework for Apache Kafka. Jikkou helps you implement GitOps for Kafka at scale!
🚀 Azkarra is a lightweight java framework to make it easy to develop, deploy and manage cloud-native streaming microservices based on Apache Kafka Streams.
Kafka data generator and load testing tool - generate fake messages, simulate producers and consumers, test broker failures, and run chaos engineering scenarios
Kafta is a command line for managing Kafka clusters
Command Line Interface for the Strimzi Kafka Operator
Object Detection and Analysis Made easy using Raspberry Pi, Apache Kafka, AWS Rekognition & Docker
The developer-friendly ETL platform for transforming data in real-time. Based on Apache Kafka® and Kubernetes®.
📡 Real-time data pipeline with Kafka, Flink, Iceberg, Trino, MinIO, and Superset. Ideal for learning data systems.
Alpine Linux based Kafka Docker Image
Agentic Data Integrator that helps you build production-ready data pipelines so you can connect to more systems, faster. You run it in your terminal as a workflow wizard.
Sample code that shows the important aspects of developing custom connectors for Kafka Connect. It provides the resources for building, deploying, and running the code on-premises using Docker, as well as running the code in the cloud.
AI agent skills for building, operating and troubleshooting Apache Kafka applications. Topic audit, consumer lag, schema review, security, connectors and DLQ
Open source, accessibility driven web application for monitoring and alerting Apache Kafka broker metrics
The one-stop shop Docker Desktop Extension for seamless Kafka cluster monitoring and troubleshooting 🐋 🚀
rtdl makes it easy to build and maintain a real-time data lake
Fully Managed Apache Kafka Cluster with Ansible & Terraform.
Confluent for Visual Studio Code
A comprehensive Message Control Protocol (MCP) server for Kafka Schema Registry.
This demo application showcases the implementation of Spring Boot microservices, highlighting their powerful features and capabilities, with a particular emphasis on integrating OpenAI for advanced AI functionalities.
Data Engineering portfolio projects, resources used to study data tools...
By Smart Shaped s.r.l. (https://www.smartshaped.com/)
A end-to-end real-time stock market data pipeline with Python, AWS EC2, Apache Kafka, and Cassandra Data is processed on AWS EC2 with Apache Kafka and stored in a local Cassandra database.
End-to-end data engineering pipeline with various technologies to ingest real time data.
Designed and implemented a full-scale Data Engineering solution, covering data ingestion, transformation, orchestration, storage, monitoring, and analytics using industry-standard tools and cloud technologies to deliver reliable, scalable, and business-ready data pipelines.
Real-Time M-Pesa Transaction Streaming Pipeline built using modern data engineering technologies to ingest, process, stream, and analyze transaction data in real time. Demonstrates event-driven architecture, stream processing, data pipelines, and scalable analytics for fintech applications.
Open-Source Apache Kafka Governance Platform
A structured streaming was applied to the robot data from ROS-Gazebo simulation environment using Apache Spark. Data is collected in Kafka, analyzed by Apache Spark and stored in Cassandra.
Spark Structured Streaming data pipeline that processes movie ratings data in real-time.
End to End Data Engineering Projects
This project builds a scalable log analytics pipeline use Lambda architecture for real-time and batch processing of NASA server logs.
Data Engineering Projects
Pre-crime intelligence system for mule account detection. Catches the warming phase 72 hours before illicit funds arrive.| iDEA 2.0 | PS3