#Datapipeline

duoan

mega-data-factory

🏭 Mega Scale Multimodal DataPipeline for SOTA Foundation Models

ErdemOzgen

Data-Engineering-Roadmap

Roadmap for Data Engineering

kartik4949

TensorPipe

High Performance Tensorflow Data Pipeline with State of Art Augmentations and low level optimizations.

cloudposse

terraform-aws-efs-backup

Terraform module designed to easily backup EFS filesystems to S3 using DataPipeline

KennethanCeyer

awesome-data-pipeline

Awesome list for datapipeline

ankiano

etl

Extract transform load CLI tool for extracting small and middle data volume from sources (databases, csv files, xls files, gspreadsheets) to target (databases, csv files, xls files, gspreadsheets) in free combination.