#Apache-airflow
Showing 48 of 48 repositories tagged #apache-airflow, ranked by stars
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Elyra extends JupyterLab with an AI centric approach.
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
Apache Airflow tutorial
Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.
Helm Charts for the Astronomer Platform, Apache Airflow as a Service on Kubernetes
CLI that makes it easy to create, test and deploy Airflow DAGs to Astronomer
Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethereum-smart-contract-into-bigquery-in-8-mins-bab5db1fdeee
AI agent tooling for data engineering workflows.
Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.
Kubernetes custom controller and CRDs to managing Airflow
A Helm chart to install Apache Airflow on Kubernetes
A web frontend for scheduling Jupyter notebook reports
Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.
The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such as Apache Airflow, AWS Redshift and Power BI.
Ansible role to install Apache Airflow
Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker with CeleryExecutor
Udacity Data Engineering Nanodegree Program
The practical use-cases of how to make your Machine Learning Pipelines robust and reliable using Apache Airflow.
⚡ Control Apache Airflow with natural language via MCP. Chat with your workflows using Claude, GPT, or any LLM — no REST API calls needed. Supports Airflow 2.x (43 tools) & 3.0+ (45+ tools).
PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
Companion repository to the ETL & ELT Pipelines with Apache Airflow® eBook
GitOps-first, container-native workflow orchestrator in Go (Airflow-UI compatible).
Airflow DAGs for https://github.com/blockchain-etl/bitcoin-etl
Data Engineering portfolio projects, resources used to study data tools...
An end-to-end data engineering pipeline that fetches data from Wikipedia, cleans and transforms it with Apache Airflow and saves it on Azure Data Lake. Other processing takes place on Azure Data Factory, Azure Synapse and Tableau.
ELT Data Pipeline implementation in Data Warehousing environment
End-to-end data engineering pipeline with various technologies to ingest real time data.
This repository contains the necessary configuration files and DAGs (Directed Acyclic Graphs) for setting up a robust data engineering environment using Kubernetes and Apache Airflow
Your own personal data engineer for OpenClaw.
Stop staring at cron expressions: discover the missing visual calendar that finally lets you manage DAGs like a human.
DataTalks.Club's Data Engineering Zoomcamp Project
Designed and implemented a full-scale Data Engineering solution, covering data ingestion, transformation, orchestration, storage, monitoring, and analytics using industry-standard tools and cloud technologies to deliver reliable, scalable, and business-ready data pipelines.
Stop creating bad DAGs! Use this tool to measure and compare the parse time of your DAGs, identify bottlenecks, and optimize your Airflow environment for better performance.
Skooldio: Data Pipelines with Airflow
Grupo de estudio Apache Airflow organizado por la comunidad Data Engineering Latam
🎲 Repositório para armazenar todos os componentes referentes a Data Science / Data Engineering do projeto
📊 ETL pipeline for YouTube competitor analytics. Orchestrated with Airflow, Docker, and AWS. Features sentiment analysis and a Power BI dashboard.
Opinionated framework based on Airflow 2.0 for building pipelines to ingest data into a BigQuery data warehouse
An end-to-end Twitter Data Pipeline that extracts data from Twitter and loads it into AWS S3.
Airflow DAGs for ingesting Bitcoin blockchain data to Neo4j
Dive into Apache Airflow 3 & the Airflow AI SDK! Learn to build a League of Legends data analysis pipeline using Google Gemini, Dynamic Task Mapping, & DAG versioning for AI-powered champion insights.
Pipeline for Automated Updates of Kaggle's "Formula 2 Dataset"
Automate your data pipelines using Apache Airflow with this ready-to-use DAG for data integration, ETL and workflow automation.
Social Media Analysis, scalable solution, flexible deployment that analyses social media contents