About the role
- Design and develop data pipelines using Azure Databricks
- Lead and mentor data engineering team members
- Work with stakeholders to understand business requirements
- Ensure high performance, scalability, and reliability of data solutions
- Optimize ETL/ELT processes and data workflows
- Collaborate with architects and cross-functional teams
- Review code and ensure best practices are followed
- Strong experience in Azure Databricks
- Hands-on experience with Azure Data Factory (ADF), ADLS, Azure SQL
- Good knowledge of PySpark / Spark / SQL
- Experience in data warehousing and ETL/ELT processes
- Strong problem-solving and leadership skills
- Experience with Power BI or reporting tools
- Knowledge of CI/CD and DevOps practices
- Azure certifications (DP-203, AZ-900, etc.)