About the role
1. Data Engineer:
Core Skills and Knowledge:
- 7-9 years of experience in data engineering.
- Hands-on experience with Databricks (Delta Lake, notebooks, Databricks Workflows).
- Strong programming skills in Python and SQL.
- Working knowledge of Apache Spark (PySpark preferred) for data transformation.
- Experience with either AWS (S3, Glue, EMR) or Azure (ADLS Gen2, Data Factory, Synapse) services.
- Understanding of data modeling concepts (star schema, dimensional modeling).
- Familiarity with version control (Git) and basic CI/CD practices.
Desirable Skills:
- Databricks Certified Data Engineer Associate (or working toward it).
- Exposure to streaming data pipelines (Structured Streaming, Kafka, Kinesis, or Event Hubs).
- Familiarity with orchestration tools (Airflow, Databricks Workflows).
- Basic understanding of data governance and security practices (PII masking, access control).
- Exposure to Power BI or other BI tools for understanding downstream