About the role
We are looking for professionals with 5-9 years of experience in Data Engineering and strong expertise in Python, Scala, SQL, Apache Spark, Airflow, Databricks, Snowflake, and AWS. Experience working with large-scale data pipelines, ETL/ELT processes, and cloud-based data platforms is highly preferred.
Requirements:
- 5-9 years of experience in Data Engineering or Big Data technologies.
- Strong programming experience in Python and/or Scala.
- Advanced knowledge of SQL, query optimisation, and data modelling.
- Hands-on experience with Apache Spark (PySpark/Scala) for distributed data processing.
- Strong experience with Databricks and the Lakehouse architecture.
- Experience with Snowflake, including data loading, transformations, performance tuning, and optimisation.