#Apache-iceberg
Showing 15 of 15 repositories tagged #apache-iceberg, ranked by stars
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
Open source security data lake for threat hunting, detection & response, and cybersecurity analytics at petabyte scale on AWS
The Open source Resource as Code framework for Apache Kafka. Jikkou helps you implement GitOps for Kafka at scale!
Use SQL to build ELT pipelines on a data lakehouse.
Icebird: JavaScript Iceberg Client
📡 Real-time data pipeline with Kafka, Flink, Iceberg, Trino, MinIO, and Superset. Ideal for learning data systems.
A local-first lakehouse reference architecture for production-minded data platform engineering.
DAIVI is a reference solution with IAC modules to accelerate development of Data, Analytics, AI and Visualization applications on AWS using the next generation Amazon SageMaker Unified Studio. The goal of the DAIVI solution is to provide engineers with sample infrastructure-as-code modules and application modules to build their data platforms.
Frontend & BFF (Backend for frontend) for Olake. This includes the UI code and backend code for storing the configuration of sync and orchestrating it.
Spark data pipeline that processes movie ratings data.
K2I - Kafka to Iceberg streaming ingestion engine. A Rust CLI tool inspired by Moonlink architecture that consumes from Kafka, buffers with Apache Arrow for sub-second query freshness, and writes to Apache Iceberg tables.
Spark Structured Streaming data pipeline that processes movie ratings data in real-time.
Automated setup of Apache Iceberg on Amazon S3 using Terraform and AWS Glue Data Catalog. Explore the power of a Lakehouse architecture for data management and analysis, featuring schema discovery, metadata management, and efficient querying with Amazon Athena.
An Iceberg destination for DLT that supports REST catalogs