About the role
We are looking for an experienced Senior Data Engineer with strong expertise in Azure, Databricks, Apache Spark, Python, and advanced SQL. The ideal candidate will design and build scalable, end-to-end data pipelines and contribute to engineering standards, code quality, and technical decision-making.
Responsibilities:
- Design, develop, and maintain end-to-end data pipelines covering data acquisition, ingestion, data lakes, and data consumption.
- Build scalable data processing solutions using Azure, Databricks, Apache Spark, Python, and SQL/T-SQL.
- Develop, optimize, and maintain data pipelines for enterprise-scale applications and analytics.
- Work with SAS code and integrate data from multiple sources.
- Implement and maintain CI/CD pipelines, Git workflows, release management, and code reviews.
- Ensure secure development practices, engineering standards, and technical debt management.
- Conduct technical design and code reviews to maintain code quality.
- Mentor engineers, coach squads, and lead technical workshops.
- Collaborate with business stakeholders, architects, and engineering teams to deliver reliable data solutions.
Requirements:
- Required Skills: Azure Cloud and Data Engineering, Databricks and Apache Spark, Advanced SQL / T-SQL, Python Programming, End-to-End Data Pipeline Development, CI/CD, Git and Release Management, Code Reviews and Secure Development Practices, SAS Code Experience.