About the role
JD
- 10+ years of experience in data architecture and engineering, with 5+ years in Databricks and Apache Spark.
- Deep expertise in Delta Lake, structured streaming, PySpark, and SQL.
- Strong understanding of Lakehouse architecture, data mesh, and modern data stack principles.
- Experience with Unity Catalog, Databricks Repos, Jobs API, and Workflows.
- Proven ability to design and implement secure, governed, and highly available data platforms.
- Familiarity with cloud platforms (Azure, AWS, GCP) and their integration with Databricks.
- Experience with data modeling, dimensional modeling, and temporal data structures.
- Experience with CI/CD, DevOps, and infrastructure-as-code tools (Terraform, GitHub Actions, Azure DevOps).
- Knowledge of machine learning lifecycle, MLflow, and model deployment strategies.
- An understanding of E-R data models (conceptual, logical, and physical).
- Understanding of advanced data warehouse concepts is required
Qualifications: BACHELOR OF ENGINEERING