#Data-warehouse
Showing 55 of 55 repositories tagged #data-warehouse, ranked by stars
🦔 PostHog is an all-in-one developer platform for building successful products. We offer product analytics, web analytics, session replay, error tracking, feature flags, experimentation, surveys, data warehouse, a CDP, and an AI product assistant to help debug your code, ship features faster, and keep all your usage and customer data in one stack.
A curated list of awesome big data frameworks, ressources and other awesomeness.
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
Privacy and Security focused Segment-alternative, in Golang and React
The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.
[NOT MAINTAINED] Light-weight Python OLAP framework for multi-dimensional data analysis
TensorBase is a new big data warehousing with modern efforts.
One advanced and mature open-source MPP (Massively Parallel Processing) database. Open source alternative to Greenplum Database.
Personal Data Engineering Projects
A comprehensive guide to building a modern data warehouse with SQL Server, including ETL processes, data modeling, and analytics.
Data API Framework for AI Agents and Data Apps
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
Supercharge BigQuery with BigFunctions
This repository has been merged into Canner/WrenAI under the core/ directory
High-performance analytical database. 19.9M records/sec ingestion, 8.4M+ rows/sec queries. Ingestion, compaction, SQL, retention, continuous queries — one binary. Open Parquet on your storage. S3/Azure native. Air-gap ready. No vendor lock-in. AGPL-3.0.
A curated list of open source tools used in analytics platforms and data engineering ecosystem
One framework to develop, deploy and operate data workflows with Python and SQL.
Titan Core - Snowflake infrastructure-as-code. Provision environments, automate deploys, CI/CD. Manage RBAC, users, roles, and data access. Declarative Python Resource API. Change Management tool for the Snowflake data warehouse.
Construct a modern data stack and orchestration the workflows to create high quality data for analytics and ML applications.
Airbyte made simple (no UI, no database, no cluster)
This is a template you can use for your next data engineering portfolio project.
Analytics - Open source data warehouse and reporting for Nextcloud
A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for cloud data warehouse and Metabase to serve the needs of data visualizations such as analytical dashboards.
Modern serverless lakehouse implementing HOOK methodology, Unified Star Schema (USS), and Analytical Data Storage System (ADSS) principles on Adventure Works. Features programmatic model generation, event-enhanced Puppini bridges, and temporal resolution across DAS/DAB/DAR layers.
DecisionBox connects to your data warehouse, runs autonomous AI agents that write and execute SQL, and surfaces validated insights and actionable recommendations — without you asking a single question.
Beneath is a serverless real-time data platform ⚡️
Greengage DB is an open source MPP database platform based on Greenplum® database software.
Detailed notes and homeworks from 2025 Data Engineering Zoomcamp by Datatalks.Club
Data Engineer with Python lecture notes from #datacamp.
Example project demonstrating deployment patterns for real-time streaming workflows with Prefect 2.0
Load data from the Oura Ring API into a personal data warehouse
Arcane Insight is a data analytics project designed to harness the power of SQLMesh & DuckDB to collect, transform, and analyze data from Blizzard’s Hearthstone API. Focused on card statistics and attributes, this project reveals detailed insights into card mechanics, strengths, and trends to support BI and strategic analysis.
An end-to-end data pipeline which extracts divvy bikeshare data from web loads it into data lake and datawarehouse transforms it using dbt and finally , a dashboard to visualize the data using looker studio, the pipeline is orchestrated using prefect
Solution for IBM Data Engineering Professional Certificate
Portfolio of projects and studies conducted in data engineering.
Download and warehouse historical trading data
Data Engineering - Metropolitan Transportation Authority (MTA) Subway Data Analysis
Never sift through endless dbt™ logs again. dbt Command Center is a free, open-source, local web application that provides a user-friendly interface to monitor and manage dbt runs.
Reverse ETL for the code-first data stack
Starter project for building an ETL pipeline using SSIS in Visual Studio 2019
SQL practice repository covering data analysis, joins, aggregations, window functions, and real-world query solving for data engineering and analytics.
Try out Apache Cloudberry (Incubating) via the Docker-based Sandbox
电商全域数据治理与 Multi-Agent 分析中台：基于 n8n + LLM 架构，实现多源电商数据 ETL、规范化数仓分层建模 (DWD/ADS) 及飞书端智能对话查询闭环。
DS525
Data Brewery is an ETL (Extract-Transform-Load) program that connect to many data sources (cloud services, databases, ...) and manage data warehouse workflow.
Pipeline, warehouse, and visualization tools for investigating the impact of Airbnb short-term rentals on world cities.
A collection of data engineering projects: data modeling, ETL pipelines, data lakes, infrastructure configuration on AWS, data warehousing, containerization, and a dashboard to monitor data pipeline KPIs
Open source Snowflake cost proxy. Verified caching, suspend, rewrites, attribution, and signed savings evidence.
Huemul BigDataGovernance, es una framework que trabaja sobre Spark, Hive y HDFS. Permite la implementación de una estrategia corporativa de dato único, basada en buenas prácticas de Gobierno de Datos. Permite implementar tablas con control de Primary Key y Foreing Key al insertar y actualizar datos utilizando la librería, Validación de nulos, largos de textos, máximos/mínimos de números y fechas, valores únicos y valores por default. También permite clasificar los campos en aplicabilidad de derechos ARCO para facilitar la implementación de leyes de protección de datos tipo GDPR, identificar los niveles de seguridad y si se está aplicando algún tipo de encriptación. Adicionalmente permite agregar reglas de validación más complejas sobre la misma tabla.
Building a modern data warehouse with Microsoft SQL Server, including ETL processes with Bronze Layer, Silver Layer and the Gold Layer, data modeling and as well as analytics.
Automate your data pipelines using Apache Airflow with this ready-to-use DAG for data integration, ETL and workflow automation.
Building a next-generation hybrid data pipeline architecture that combines the power of Microsoft Fabric, Azure Cloud, and Power BI. This pipeline is engineered to tackle the challenges of real-time data ingestion, multi-layered processing, and analytics, delivering business-critical insights.