About the role
Senior DevOps Engineer with strong expertise in Python, Databricks, Azure Cloud, and data workflow orchestration. This role will focus on building scalable infrastructure, automating deployments, and supporting data engineering pipelines using Bicep, Azure Data Factory (ADF), and Apache Airflow. Also working on the data using databricks.
Skills
Programming:
Advanced Python with Pytest
Cloud:
Azure: ADF, Azure Functions, Azure DevOps, Azure Monitor, Key Vault, Databricks,Blob storage and ADLS.
Bicep: Azure-native IaC for declarative infrastructure.
CI/CD & Deployment
Architect CI/CD pipelines integrating Python apps, ADF pipelines, and Airflow DAGs.
Implement automated testing, security scanning, and deployment workflows.
Use tools like GitHub Actions, Azure DevOps, GitLab CI, or Jenkins.
Docker & Kubernetes:
Containerization and orchestration.
Workflow Orchestration
Apache Airflow: DAG creation, scheduling, monitoring.
Azure Data Factory:
pipeline design, data movement, transformation.
Monitoring & Logging:
ELK Stack, Azure Monitor, Datadog.
Security & Compliance:
IAM, RBAC, secrets management.
CMDB:
&nb sp; Able to create Application CIs and Sub applications
Able to register pipelines via CI/CD
Qualifications: BACHELOR OF TECHNOLOGY