About the role
Requirements:
- 4+ years of experience in data engineering, data platforms, and analytics on the Databricks platform.
- Experience with large-scale data migrations to/from Databricks.
- Consulting / customer-facing experience, working with external clients across a variety of industry markets.
- Comfortable writing code in either Python or Scala.
- Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one.
- Deep experience with distributed computing with Apache SparkTM and knowledge of Spark runtime internals.
- Familiarity with CI/CD for production deployments.
- Working knowledge of MLOps.
- Design and deployment of performant end-to-end data architectures.
- Experience with technical project delivery - managing scope and timelines.
- Documentation and white-boarding skills.
- Experience working with clients and managing conflicts.
- Deployment and integration of Databricks-based solutions to complete customer projects.
- Must have Databricks Certifications.
- Strong communication and collaboration skills.
- Excellent problem-solving skills.
- Ability to travel up to 30% when needed.