About the role
Data Engineer (Platform Engineering Focus)
The Opportunity:
The Platform Engineer builds, automates, and supports the shared cloud platform services that enable reliable data, analytics, and AI delivery.
This hands-on role works with Senior Platform Engineers, Data Engineers, Analytics Engineers, Security, and Architecture teams to provision environments, implement deployment automation, monitor platform health, resolve incidents, and improve the developer experience.
What you’ll do…
Platform Build & Operations
- Provision and configure Databricks, Azure Data Lake, Microsoft Fabric, and supporting cloud resources using approved patterns.
- Maintain workspace, compute, storage, identity, access, secrets, and environment configurations.
- Execute platform upgrades, configuration changes, maintenance activities, and production deployments.
- Support environment readiness for data engineering, analytics, governance, and AI teams.
Automation & CI/CD
- Develop and maintain infrastructure-as-code modules, deployment scripts, and CI/CD pipelines.
- Automate repeatable administrative, monitoring, access, and environment-management tasks.
- Maintain source-control, branching, release, artifact, and environment-promotion processes.
- Contribute to self-service templates and reusable engineering components.
Monitoring, Support & Optimization
- Monitor platform availability, performance, capacity, security events, and job health.
- Respond to incidents and service requests; troubleshoot issues and document root causes and resolutions.
- Maintain operational dashboards, alerts, runbooks, knowledge articles, and support procedures.
- Identify and implement opportunities to improve reliability, performance, and cloud cost efficiency.
Security, Governance & Collaboration
- Apply approved identity, access, networking, logging, classification, and audit controls.
- Support integration with Unity Catalog, Microsoft Purview, and enterprise security services.
- Work with engineering and analytics teams to resolve platform dependencies and remove delivery blockers.
- Participate in design reviews, sprint planning, testing, documentation, and continuous-improvement activities.
Who you are?
- 3+ years of experience in cloud engineering, DevOps, platform operations, data platform support, or a related role.
- Hands-on experience with Microsoft Azure and familiarity with Databricks or a comparable data platform.
- Experience with infrastructure as code, CI/CD pipelines, source control, and deployment automation.
- Working knowledge of cloud networking, identity and access management, storage, compute, monitoring, and security concepts.
- Scripting experience using Python, PowerShell, Bash, or a comparable language.
- Strong troubleshooting, documentation, communication, and collaboration skills.
- Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field; equivalent practical experience will be considered.
Preferred Qualifications
- Experience with Terraform, Bicep, Azure DevOps, GitHub Actions, Unity Catalog, Microsoft Fabric, or Microsoft Purview.
- Familiarity with lakehouse, Spark, SQL, data pipelines, and AI/ML platform workloads.
- Cloud or Databricks certification.
- Experience working in Agile or product-oriented delivery teams.
#LI-VK