#Data-modeling
Showing 33 of 33 repositories tagged #data-modeling, ranked by stars
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
Open-source BI for engineers
The best place to learn data engineering. Built and maintained by the data engineering community.
Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
Personal Data Engineering Projects
LLM-based ontological extraction tools, including SPIRES
do more with dbt. dbt-fal helps you run Python alongside dbt, so you can send Slack alerts, detect anomalies and build machine learning models.
ATTENTION: This repository is a clone of https://gitlab.structr.com/structr/structr. All development/issue tracking has moved there. | Structr is an integrated open-source low-code development and runtime environment that uses a graph database (Neo4j).
A developer experience centered on CUE. Unifies schemas, data models, deterministic and agentic code generation, workflow and task engine, dagger powered environments, coding assistant, and vscode extension; woven together on the CUE lattice. Squint harder if you can't see the cube :]
A hackable data integration & analysis tool to enable non technical users to edit data processing jobs and visualise data on demand.
Create diagrams and plan your code with TypeScript.
ER diagram generator. Paste CREATE TABLE statements and get a clean, interactive ERD — runs 100% in your browser, nothing uploaded
Repository for the ActivitySchema spec and supporting materials
Tellery lets you build metrics using SQL and bring them to your team. As easy as using a document. As powerful as a data modeling tool.
Projects done in the Data Engineering Nanodegree by Udacity.com
The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such as Apache Airflow, AWS Redshift and Power BI.
Modern serverless lakehouse implementing HOOK methodology, Unified Star Schema (USS), and Analytical Data Storage System (ADSS) principles on Adventure Works. Features programmatic model generation, event-enhanced Puppini bridges, and temporal resolution across DAS/DAB/DAR layers.
Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).
:book: R 语言数据分析实战(写作中) Data Analysis in Action Using R
Data engineering interview prep - PySpark notebooks, theory docs, quizzes, and company-specific patterns. Built around Zephyr Coffee Co., a fictional 200-store chain with messy data.
Sales insights project using Powerbi and SQL
Leveraging Intelligent Processing Tools and Algorithms to help the Visually Impaired see and navigate 💥✨
An end-to-end data pipeline which extracts divvy bikeshare data from web loads it into data lake and datawarehouse transforms it using dbt and finally , a dashboard to visualize the data using looker studio, the pipeline is orchestrated using prefect
Portfolio of projects and studies conducted in data engineering.
Data Engineering - Metropolitan Transportation Authority (MTA) Subway Data Analysis
JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.
This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.
Comprehensive Power BI resources covering interview questions, group training materials, project portfolio ideas, and a cheat sheet for quick reference. Elevate your Power BI skills with curated content designed to enhance your proficiency and boost project success.
Using R and machine learning to build a classifier that can detect credit card fraudulent transactions.
DS525
End-to-end AI-powered Data Engineering preparation repository covering SQL, PySpark, Azure, AWS, GCP, Data Modeling, Pipelines, and real-world projects with interview-focused explanations.
A project to design a fact and dimension star schema for optimizing queries on a flight booking database using PostgreSQL, a relational database management system. This schema is well-suited for a flight booking database, as it allows for efficient querying of data such as booking dates, flight routes, and passenger information.