About the role
- U nderstand the overall requirement design of the enterprise cloud migration strategy (Data)
- Work closely with other architects and tech leads in India US to understand the existing data pipeline developed in Databricks GCP
- Develop and take accountability of core modules in Databricks GCP
- Explore designs and create POCs to address business requirements
- Lead other developers, review their code and ensure quality optimal code is being delivered
- Provide regular updates on the tasks, status and risks to project manager
The experience we are looking to add to our team
Required
- 10+ years total experience with majority of that experience related to ETL, big data Databricks
- Strong Hands on experience in PySpark Databricks (minimum 3+ years)
- Extensive experience in implementing large scale data ingestion and curation solutions in using Databricks
- Good hands on experience in big data technology stack with any cloud platform -
- Experience designing and deploying data pipelines orchestration using Apache Airflow / Cloud Composer
G ood to have
- Experience in Google Cloud
- Experience in processing streaming data using Kafka / Pub-Sub
- Healthcare industry experience
- Experience in Agile