About the role
Work on large-scale data engineering problems involving data modelling, ETL pipelines, data warehousing, orchestration, and performance optimisation. You'll collaborate with engineering, analytics, infrastructure, and business teams to build scalable data solutions that directly support business decision-making and revenue initiatives.
Responsibilities:
- Partner with technical and non-technical stakeholders to understand data, reporting, and business requirements.
- Work with engineering teams to collect and integrate data from internal and external systems.
- Design scalable and performant data models, including dimensional modelling and database normalisation.
- Design and develop robust ETL/ELT pipelines and define appropriate data integration strategies.
- Develop and maintain ETL workflows using orchestration tools such as Apache Airflow.
- Build and implement automated Data Quality checks to ensure accuracy, consistency, and reliability of data.
- Work with relational databases and distributed data systems such as Snowflake or Amazon Redshift.
- Perform advanced SQL and ETL performance tuning to optimise data processing and query performance.
- Work with technologies such as Python, PySpark, Spark, Databricks, Snowflake or EMR for large-scale data processing.
- Implement database deployments and schema changes using tools such as Schema Change.
- Build and report on business KPIs and metrics within data warehousing environments.
- Perform ad hoc data analysis and support business teams with data-driven insights.
- Participate in Agile/Scrum ceremonies and collaborate closely with cross-functional engineering and analytics teams.
Requirements:
- 5+ years of experience in Data Engineering with strong hands-on experience building data pipelines and data warehouse solutions.
- Strong understanding of data modelling principles, including dimensional modelling and normalisation.
- Strong SQL expertise with the ability to analyse and optimise complex queries and data workloads.
- Strong analytical and problem-solving skills with the ability to translate business requirements into scalable data solutions.