#Aws-redshift
Showing 12 of 12 repositories tagged #aws-redshift, ranked by stars
Personal Data Engineering Projects
Redshift Python Connector. It supports Python Database API Specification v2.0.
Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such as Apache Airflow, AWS Redshift and Power BI.
Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation, validation and loading of data from S3 -> Redshift -> S3
Guidance for Clickstream Analytics on AWS source code
Udacity Data Engineering Nanodegree Program
:arrows_counterclockwise: :running: EtLT of my own Strava data using the Strava API, MySQL, Python, S3, Redshift, and Airflow
Project was based on an interest in Data Engineering, ETL pipeline. It also provided a good opportunity to develop skills and experience in a range of tools. As such, project is more complex than required, utilising dbt, airflow, docker and cloud based storage.
A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from locally hosted Airflow containers. The end product is a Superset dashboard and a Postgres database, hosted on an EC2 instance at this address (powered down):
This project provides valuable customer sentiment insights for Zomato by tracking and analyzing tweets related to their brand and services.