Skip to content
View MoTahaAboHeiba's full-sized avatar
👽
Focusing
👽
Focusing
22 followers · 32 following

Achievements

Achievement: Pull SharkAchievement: YOLO

Achievements

Achievement: Pull SharkAchievement: YOLO

Block or report MoTahaAboHeiba

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
MoTahaAboHeiba/README.md
Header Typing SVG

Data Engineer specializing in cloud-native pipelines and lakehouse architecture. AWS & Huawei certified, building production systems on Databricks, Spark, and Airflow, with hands-on work extending into retrieval infrastructure for AI applications.

How I Think About Data Engineering

I treat data infrastructure as a systems problem: correctness before performance, observability from day one, and hard boundaries between pipeline layers. A pipeline that runs once is not the same as one that runs reliably at scale.

My work spans batch ETL on Databricks, streaming with Kafka and Flink, SQL Server warehouses built on stored-procedure layers, and production RAG APIs with offline evaluation harnesses. The same rigor applies everywhere.

Current Focus

  • Medallion Architecture pipelines on Databricks and Delta Lake
  • Cloud-native data platforms on AWS: Glue, Redshift, EMR, Athena
  • DE for AI workflows: vector indexing, hybrid retrieval, and retrieval evaluation
  • ETL orchestration with Apache Airflow

Tech Stack

Core

Big Data & Processing

Orchestration & Storage

Cloud — AWS

AI Data Engineering

Analytics & BI

Certifications

Certification Issuer Valid Until
AWS Certified Cloud Practitioner (CLF-C02) Amazon Web Services May 2029
HCIA Big Data Associate Huawei Technologies March 2029

GitHub Stats

Contribution Activity

snake animation

Email · LinkedIn · Portfolio · Resume

Building data systems that are reliable by design, maintainable in practice, and useful to the business.

Take a Look at my pinned projects Down Here

Pinned Loading

  1. retail-lakehouse-pipeline retail-lakehouse-pipeline Public

    End-to-end lakehouse pipeline for retail data: Postgres to Databricks (incremental ingestion), dbt (incremental models, SCD2, metadata-driven OBT), Airflow orchestration, S3 secondary ingestion, CI…

    Python 17

  2. E-Commerce-Lakehouse-Using-Databricks E-Commerce-Lakehouse-Using-Databricks Public

    End-to-end E-Commerce Lakehouse built on Databricks using Medallion Architecture (Bronze → Silver → Gold). Ingests raw CRM and ERP data, applies PySpark transformations, and delivers a star schema …

    Jupyter Notebook 10

  3. SQL-Data-Warehouse-project SQL-Data-Warehouse-project Public

    Building a Modern Data Warehouse using SQL Server, Including ETL processes, Data modeling, Data analytics.

    TSQL 10

  4. EduMate-RAG EduMate-RAG Public

    FastAPI RAG microservice powering the AI layer of EduMate, indexes 50+ CS textbooks into ChromaDB for Dev and Qdrant Cloud for development, retrieves via cosine similarity, and generates grounded a…

    Python 14