About the role
Requirements:
- 6-9 years of experience in data engineering.
- Expert-level proficiency and hands-on experience in Python and Scala.
- Experience in SQL.
- Deep hands-on expertise with Apache Spark.
- Proven experience working with and implementing the Lakehouse Architecture using the Medallion Model (Bronze, Silver, Gold layers).
- Proven experience with MySQL, PostgreSQL, and MongoDB.
- Solid understanding of various ETL/data streaming architectures, including Kappa and Lambda architectures.
- Hands-on with Data Observability and Monitoring using Grafana and Prometheus.
- Hands-on experience with message brokers such as Kafka and/or Google Pub/Sub.
- Strong knowledge of data modeling principles (designing fact tables, dimension tables, and data marts).
- Hands-on in deployment using Kubernetes.
- Experience working in a multi-cloud environment, specifically with AWS and/or GCP.
- Practical experience with cloud-native or modern query engines like BigQuery, Trino, and/or Redshift.