About the role
We are looking for an experienced Azure Data Engineer with strong expertise in Azure Data Engineering technologies, Microsoft Fabric, and Unity Catalog. The ideal candidate should have hands-on experience in building scalable cloud-based data platforms and implementing modern data engineering solutions using Azure services. The candidate will work closely with cross-functional teams, business stakeholders, and architects to design, develop, and optimize enterprise data solutions.
Responsibilities:
- Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks, and Microsoft Fabric.
- Build and optimize data solutions using Azure Synapse Analytics, Azure Data Lake, SQL Database, and Fabric Lakehouse.
- Develop data transformation workflows using PySpark and SQL.
- Implement enterprise data models, data warehousing, and lakehouse architectures.
- Work with Unity Catalog and data governance tools to ensure data security and compliance.
- Collaborate with stakeholders to gather requirements and translate business needs into technical solutions.
- Monitor and improve performance, scalability, and reliability of data platforms.
- Implement CI/CD pipelines and deployment automation using Azure DevOps.
- Participate in architectural discussions and contribute to cloud data best practices.
- Provide technical guidance and mentor junior team members.
Requirements:
- 6+ years of experience in Data Engineering.
- Strong hands-on experience with Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics, and Microsoft Fabric.
- Proficiency in Python, PySpark, and SQL.
- Experience working with Azure Data Lake (ADLS Gen2) and Lakehouse architecture.
- Knowledge of Unity Catalog, data governance, and access management.
- Experience in building scalable and optimized ETL pipelines.
- Understanding of data modeling and database design concepts.
- Experience with CI/CD implementation using Azure DevOps.
- Good communication and stakeholder management skills.
Preferred Skills:
- Experience with enterprise-scale cloud data platforms.
- Exposure to Medallion Architecture and Delta Lake.
- Microsoft Azure certifications related to Data Engineering.
- Experience leading small teams or modules.
- Familiarity with Microsoft Purview and data governance frameworks.