Welcome to the ** Data Warehouse and Analytics Project ** repository! 🚀 This project demonstrates a comprehensive data warehousing and analytics solution, from building a data warehouse to generating actionable insights. Designed as a portfolio project, it highlights industry best practices in data engineering and analytics.
Develop a modern data warehouse using SQL Server to consolidate sales data, enabling analytical reporting and informed decision-making.
- **Data Sources**: Import data from two source systems (ERP and CRM) provided as CSV files.
- **Data Quality**: Cleanse and resolve data quality issues prior to analysis.
- **Integration**: Combine both sources into a single, user-friendly data model designed for analytical queries.
- **Scope**: Focus on the latest dataset only; historization of data is not required.
- **Documentation**: Provide clear documentation of the data model to support both business stakeholders and analytics teams.
The Data Architecture for this project follows Medallion Architecture Bronze, Silver and Gold Layers:
- Bronze Layer: Stores raw data ingested directly from source systems with minimal or no transformation. It acts as the initial landing zone for preserving the original data.
- Silver Layer: Contains cleaned, standardized, and transformed data derived from the Bronze layer. This layer improves data quality by removing duplicates, correcting formats, and applying business rules.
- Gold Layer: Houses Business- Ready Data modeled into star schema required for reporting and Analytics.
This project is licensed under the MIT License. You are free to use, modify, and share this project with proper attribution.
⸻
Hi there! I’m Veeda Saldanha. I’m an Intern passionate about Data Science, Data Warehousing, and Analytics. I enjoy teaching, building practical projects, and sharing knowledge in a simple and engaging way.