About the role
Responsibilities:
- Design, build, and test scalable data platform solutions in Azure, leveraging tools like ADF, Databricks, and Function Apps, using Python.
- Develop high-quality data products, ensuring efficiency, reliability, and performance across our data pipelines.
- Collaborate closely with product and marketing teams to deliver data-driven insights and solutions that provide high business value.
- Write clean, maintainable code following best practices and development frameworks, ensuring robust data engineering standards.
- Continuously improve and optimise data workflows, monitoring performance and implementing enhancements to drive innovation.
Requirements:
- Experience in designing, building, and testing solutions within a data lakehouse environment.
- Proficiency in Python and PySpark for data processing and analytics.
- Strong SQL skills for querying and managing data.
- Hands-on experience with Azure, preferably ADF, Databricks, and Function Apps.
- Familiarity with CI/CD pipelines using Azure DevOps or similar tools.
- Ability to work within established development frameworks and adhere to coding standards.
Preferred:
- Strong teamwork skills, with a collaborative mindset and desire to learn from others.
- A proactive attitude with a passion for continuous learning and growth.
- High attention to detail and commitment to delivering quality work.
- Comfortable working in a fast-paced environment, with the ability to estimate tasks and deliver incremental value effectively.