Implementing Medallion Architecture
12 Inputs
2 Hours 30 Minutes
Intermediate
Client Readiness Azure - 03
Industry
e-commerce
Skills
approach
data-wrangling
batch-etl
data-quality
Tools
databricks
spark
Learning Objectives
Design and implement an ETL/ELT pipeline using Delta Lake, following the Medallion Architecture.
Overview
This covers designing a structured data pipeline using the Medallion Architecture (Bronze, Silver, Gold) to efficiently manage raw, cleaned, and aggregated data in Delta Lake
Prerequisites
- Familiarity with Databricks
- Familiarity with Building Medallion Architecture