Design and implement an ETL/ELT pipeline using Delta Lake, following the Medallion Architecture.
Overview
This covers designing a structured data pipeline using the Medallion Architecture (Bronze, Silver, Gold) to efficiently manage raw, cleaned, and aggregated data in Delta Lake