About the role
Requirements:
- Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field.
- 5+ years of hands-on experience in data engineering roles, with strong experience in ETL/ELT pipeline development and cloud-based data platforms.
- Strong proficiency in SQL and Python or Scala for data transformation, orchestration, and performance tuning.
- Hands-on experience with Databricks, Spark, Azure Data Factory, and Medallion architecture implementation.
- Strong knowledge of source database technologies including Oracle, SQL MI, and MongoDB.
- Experience with file-based ingestion patterns involving CSV, Parquet, JSON, and similar formats.
- Strong data modelling expertise, particularly in designing standardised and business-ready datasets within the Silver layer.
- Understanding of data warehousing, reporting, and downstream analytics concepts.
- Knowledge of automated testing practices for data pipelines and transformations.
- Strong analytical and problem-solving skills with the ability to diagnose issues and implement effective solutions.
- Strong verbal and written communication skills with the ability to work effectively with technical and business stakeholders.
- Ability to work independently, manage priorities, and lead technical initiatives.
- Strong attention to detail and commitment to data quality, integrity, and consistency.
Good to Have:
- Experience with cloud platforms such as Azure, AWS, or GCP.
- Knowledge of CI/CD tools and practices.
- Exposure to data governance and security frameworks.