Data Engineering Youtube Project
-
Updated
Jun 29, 2023 - Jupyter Notebook
Data Engineering Youtube Project
This project is a data pipeline that ETL Reddit data into a Redshift data warehouse. The pipeline includes a combination of tools and services: Apache Airflow, Celery, PostgreSQL, Amazon S3, AWS Glue, Amazon Athena, and Amazon Redshift.
Real-time AWS ecommerce data pipeline using MSK Serverless, MSK Connect, S3, AWS Glue, Delta Lake, SCD Type 2, and Redshift Serverless.
Data engineering with a focus on AWS cloud services.
End-to-End Serverless Retail Data Lake & Analytics Pipeline using Python, PostgreSQL, AWS S3, AWS Lambda, AWS Glue, Amazon Athena, and Power BI.
AWS-based customer behavior analytics pipeline using S3, Glue, Athena, and SQL to analyze retention, revenue patterns, and customer segmentation.
AWS Serverless ETL Pipeline using Lambda, S3, Glue Crawler, Athena, Pandas and PyArrow
To associate your repository with the amazon-glue topic, visit your repo's landing page and select "manage topics."