#Glue

travis-ci

terraform-config

Terraform bits and bytes

aws-samples

aws-glue-cdk-cicd

Build, Test and Deploy ETL solutions using AWS Glue and AWS CDK based CI/CD pipelines

SourabhSinghRana

real-time_crypto_data_pipeline_using_kafka

I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that utilizes Kafka to scrape, process, and load data onto S3 in JSON format. With a producer-consumer architecture, I ensure that the data is in the right format for loading onto S3 by performing minor transformations

QuantStack

glue-jupyterlab

Glue JupyterLab Extension

dogukannulu

aws_end_to_end_streaming_pipeline

An AWS Data Engineering End-to-End Project (Glue, Lambda, Kinesis, Redshift, QuickSight, Athena, EC2, S3)

wednesday-solutions

Data-Engineering-Onboarding-Starter

This repository contains a 10 step program to enter the world of Data Engineering

dogukannulu

glue_etl_job_data_catalog_s3

Glue ETL job or EMR Spark that gets from data catalog, modifies and uploads to S3 and Data Catalog