Data engineering with Azure & Databricks
ETL using Azure and Databricks with a medallion architecture (In Progress)
Project background
In this project Azure Data Factory orchestrates ingestion from an on-premise SQL Server into a data lake. Databricks processes the data across bronze, silver, and gold layers, with Azure Synapse providing the SQL serving layer for BI and analytical workloads.
Infrastructure & Architecture
