About the role
We are looking for an experienced Senior Azure Data Engineer with strong expertise in building scalable cloud-based data platforms on Azure. The ideal candidate should have hands-on experience with Microsoft Fabric, Azure Data Factory, Azure Databricks, ETL/ELT pipelines, and enterprise data warehouse solutions. The candidate will be responsible for designing, developing, and optimizing modern data engineering solutions for analytics and reporting.
Responsibilities:
- Design, develop, and maintain scalable ETL/ELT data pipelines using Azure technologies.
- Build and manage enterprise-grade data platforms using Microsoft Fabric and Azure ecosystem services.
- Develop and optimize data ingestion, transformation, and orchestration workflows using Azure Data Factory.
- Implement big data processing solutions using Azure Databricks, PySpark, and Python.
- Design and maintain data warehouse architectures and dimensional data models.
- Write complex SQL queries, stored procedures, and performance tuning for large datasets.
- Integrate structured and unstructured data from multiple data sources.
- Collaborate with business analysts, architects, and stakeholders to deliver data solutions.
- Ensure data quality, governance, security, and compliance standards are maintained.
- Monitor and troubleshoot data pipelines and optimize performance.
- Participate in code reviews, best practices, and technical mentoring.
Requirements:
- 7-10 years of experience in Data Engineering and Data Warehousing.
- Strong hands-on experience in ETL and ELT Development.
- Strong SQL and query optimization, Data Warehouse Concepts and Dimensional Modeling, Azure Data Factory (ADF), Azure Databricks, Microsoft Fabric (Mandatory), Python, and PySpark.
- Experience in handling large-scale data processing and distributed computing.
- Strong understanding of cloud-based data architectures and Azure services.
- Experience with CI/CD, version control, and deployment pipelines.
- Good analytical, problem-solving, and communication skills.
Good to Have:
- Experience with Azure Synapse Analytics.
- Exposure to Power BI and reporting tools.
- Knowledge of Delta Lake, Lakehouse architecture, and Data Governance.
- Understanding of DevOps practices in Azure.
Preferred Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- Microsoft Azure certifications are preferred.
- Experience working in Agile/Scrum environments.
Key Competencies:
- Strong problem-solving and debugging skills.
- Ability to work independently and collaboratively.
- Excellent stakeholder communication skills.
- Ability to manage multiple priorities in a fast-paced environment.