About the role
Roles & Responsibilities
- Own end-to-end delivery of data engineering initiatives, ensuring alignment with business goals, timelines, and quality standards.
- Lead multiple projects across Azure and Databricks environments.
- Provide technical leadership in designing and implementing scalable data pipelines using Python, PySpark, and Spark.
- Collaborate with business stakeholders, architects, and engineering teams to define and deliver effective data solutions.
- Drive Agile execution, including sprint planning, tracking, and continuous improvement initiatives.
- Manage project risks, dependencies, issues, and escalations to ensure successful delivery.
- Establish governance frameworks and ensure adherence to delivery processes and best practices.
- Provide regular project status updates and executive-level reporting to stakeholders.
- Lead customer and stakeholder discussions, ensuring strong engagement and expectation management.
- Participate in SOW reviews, effort estimation, project planning, and scope management.
- Ensure adherence to delivery commitments, SLAs, and quality standards.
- Mentor and guide data engineering teams, fostering collaboration, innovation, and high performance.
- Drive continuous improvement across delivery practices, processes, and technical implementations.
- Strong hands-on experience with Azure Databricks, PySpark, Python, and Apache Spark.
- Expertise in Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Azure Synapse Analytics.
- Experience designing and implementing large-scale cloud-based data platforms.
- Strong understanding of Data Warehousing, ETL/ELT frameworks, Data Governance, and Performance Optimization.
- Experience with CI/CD, DevOps practices, and Cloud-native architectures.
- Proven experience leading large-scale data engineering programs and distributed teams.
- Strong stakeholder management, client engagement, and communication skills.
- Experience managing project governance, delivery reviews, risks, and escalations.
- Hands-on experience with Agile methodologies and project delivery best practices.
- Experience with SOW creation/review, effort estimation, project planning, resource management, and scope management.
- Strong team leadership, mentoring, and people management skills.
- Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related field.
- Azure Data Engineering or Cloud certifications preferred.
- Experience delivering enterprise-scale data modernization and cloud transformation programs.
- Experience working with global delivery teams and customer-facing engagements.