About the role
Desired Competencies (Technical/Behavioral Competency)
Must-Have
·Strong hands-on experience with Databricks (Delta Lake, Jobs, Workflows, Notebooks)
·Advanced Python for data engineering (PySpark, data transformations, optimization)
·Apache Spark concepts – batch & streaming processing
·Strong SQL skills for analytics and data modelling
·Experience with Azure Data Platform (ADLS Gen2, Azure Data Factory, Azure Synapse)
·Data Modelling (Star/Snowflake), ETL/ELT pipeline design
·CI/CD, version control (Git), and Agile delivery
Good-to-Have
- Experience with Delta Live Tables, Unity Catalog
- Streaming platforms (Event Hubs, Kafka)
- Exposure to IoT / Manufacturing / Supply Chain data
- Experience with data quality, data governance, and observability tools