About the role
Requirements:
- Mandatory Skills: Databricks (PySpark/Spark), Unity Catalogue, T-SQL, Power BI, Azure Data Factory.
- Good to have Power BI and Azure DevOps.
- Very strong understanding of ETL and ELT.
- Very strong understanding of Medallion architecture.
- Very strong knowledge in PySpark and Spark architecture.
- Very strong knowledge in Unity Catalogue architecture using Databricks.
- Very strong knowledge in T-SQL.
- Good knowledge of Azure data lake architecture and access controls.
- Good knowledge of data pipeline creation and monitoring using Azure Data Factory.
- Good knowledge of CI/CD processes using Azure DevOps.