About the role
As our Lead AI Platform Architect, you will serve as the technical authority designing a secure, observable, and governed control plane across multi-cloud and on-prem environments.
Responsibilities:
- Databricks AI Gateway Leadership: Architect a centralised control plane for LLM access, agent orchestration, model governance, policy enforcement, rate limiting, and prompt protection.
- Multi-Cloud and Ecosystem Integration: Integrate diverse AI platforms including AWS Bedrock, Azure AI Foundry, ServiceNow AI Agents, Oracle AI Services, NVIDIA on-prem (Run: AI), MCP servers, and direct agent workflows.
- Observability and Telemetry: Build enterprise OTEL pipelines to route traces, logs, prompts, and metrics into Databricks MLflow, System Tables, and Unity Catalogue.
- Security and SIEM Operations: Collaborate with Infosec to implement zero-trust access (Managed/Federated Identities, RBAC) and integrate downstream telemetry with Microsoft Sentinel / Azure SIEM.
- Enterprise API Management: Connect and operationalise integrations using Azure APIM and AWS API Gateway.
- FinOps and Analytics: Partner with FinOps and business leaders to optimise LLM usage costs and build operational dashboards in Power BI and Databricks Dashboards.
Requirements:
- 11+ years of deep architectural and hands-on experience in enterprise platform engineering, cloud architecture, and AI/LLM ecosystems.
- Expertise with Databricks (AI Gateway, Unity Catalogue, MLflow, System Tables).
- Strong background in OpenTelemetry (OTEL) and building large-scale observability pipelines.
- Deep knowledge of multi-cloud architectures (AWS, Azure) and API gateways (APIM, AWS API Gateway).
- Solid foundation in Identity & Access Management (Managed Identities, Federation, RBAC, Least Privilege).
- Experience with AI/LLM security frameworks, prompt protection, and SIEM integrations (Sentinel).
- Proven track record collaborating across DevOps, SRE, FinOps, and Security teams to deliver production-grade platforms.