About the role
Responsible for end-to-end Databricks platform setup, enterprise architecture, automation, governance, security, and operations. Drive scalable platform solutions, operational excellence, and global delivery capabilities.
Responsibilities- Databricks platform setup, enterprise architecture, and cloud landing zones.
- Governance, security, IAM, and compliance standards.
- Infrastructure as Code (Terraform), platform automation, and self-service capabilities.
- CI/CD, DevOps, and multi-environment management (DEV / QA / PROD).
- Platform monitoring, operations, support, and incident management.
- Cost optimization, performance management, and resource utilization.
- Establish scalable Global Delivery (GD), nearshore operations, and managed services.
- Collaborate with SAP Datasphere, SAP BDC, and Databricks platform teams for integration.
- Own the complete platform lifecycle from setup through operations and continuous improvement.
- Grade 2/Grade 3
- 6-8 years of professional work experience in a relevant field.
- Experience in Databricks platform engineering and cloud architecture.
- Knowledge of Terraform, CI/CD, DevOps, governance, and security.
- Experience in platform operations, monitoring, and cost optimization.
- Understanding of SAP Datasphere, SAP BDC, and Databricks integration.
- Strong leadership, stakeholder management, and global delivery experience.
- SAP Datasphere, SAP BDC, and Databricks
- Proficiency in Databricks, including Delta Lake, Spark SQL.
- Strong programming skills in Python, Scala.
- Experience with Apache Spark for big data processing.
- Knowledge of SQL for querying and transforming data.
- Expertise in API development and integration (REST, GraphQL, SOAP, etc.), including authentication mechanisms (OAuth, API keys).
- Experience with data integration tools and techniques for connecting to third-party systems, CRMs, ERPs, or SaaS platforms.
- Proficiency in Power BI for creating data models, DAX queries, and interactive dashboards.
- Data Modeling: Understanding of dimensional modeling, data warehousing, and Lakehouse architecture.
- Problem-Solving: Strong analytical skills to address complex data, integration, and visualization challenges.
- Communication: Ability to translate technical concepts to non-technical stakeholders.
- Databricks certification (e.g., Databricks Certified Data Engineer Associate/Professional).
- Microsoft Power BI certification (e.g., Microsoft Certified: Data Analyst Associate).
- Experience with real-time data processing and streaming (e.g., Kafka, Spark Streaming).
- Knowledge of machine learning pipelines and integration with Databricks MLflow.