About the role
- 3+ years of experience developing data pipelines using Python/PySpark, with proficiency in Spark SQL and Azure Databricks.
- 4+ years of experience with Azure data engineering technologies, including ADLS, Unity Catalog, Azure Data Factory, Azure Databricks, and Azure SQL/Synapse.
- 4+ years of experience with SQL.
- Experience in data modelling, including dimensional modelling, star schema and snowflake schemas.
- Proficiency in version control tools such as Git and project management tools such as Jira.
- Excellent verbal and written communication skills.
- UG: B.Sc, BCA, or B.Tech/B.E. in any specialization.
- Reliable internet connectivity is required.
- Experience working with financial data or finance-related datasets.
- Experience with Structured Streaming and Azure Event Hubs.
- Experience with Declarative Automation Bundles and Spark Declarative Pipelines (SDP).
- Azure certifications.