Data Architect

JOB DESCRIPTION - DATA ARCHITECT

Azure Databricks | Insurance and Benefits Management

Experience

15+ years

Role Level

Senior / Lead Data Architect

Primary Platform

Microsoft Azure and Azure Databricks

Domain

Insurance and Benefits Management

Seeking a senior Data Architect with 15+ years of experience designing scalable, secure and governed enterprise data platforms. The role requires deep expertise in Microsoft Azure, Azure Databricks, Lakehouse architecture, data modelling, data integration, governance and AI-ready data platforms, supported by strong Insurance and Benefits Management domain experience.

• Define conceptual, logical and physical data architectures for enterprise-scale cloud data platforms.
• Design Azure Databricks Lakehouse solutions using Bronze, Silver and Gold data layers, Delta Lake and Databricks SQL.
• Define canonical, dimensional, semantic and master-data models for analytics, reporting and AI workloads.
• Architect scalable ETL/ELT, batch, API, file-based and event-driven integration patterns.
• Establish data governance using Unity Catalog, including RBAC, lineage, auditing, classification and access controls.
• Define data-quality, validation, reconciliation, exception-management and observability standards.
• Architect secure data solutions covering encryption, masking, row/column security, privacy and regulated-data controls.
• Design AI-ready data patterns for RAG, embeddings, vector search, semantic retrieval, MLflow and governed model consumption.
• Drive performance, scalability, resilience, retention and disaster-recovery architecture.
• Lead architecture reviews, technical decisions, engineering standards and mentoring across distributed teams.

Microsoft Azure; Azure Databricks; Databricks SQL; Lakehouse and medallion architecture; Delta Lake; Apache Spark and PySpark; Unity Catalog; conceptual, logical, physical and dimensional modelling; enterprise ontology and semantic-layer design; master-data management and identity resolution; ETL/ELT and distributed processing; data-quality and reconciliation frameworks; Databricks Genie; MLflow and Databricks Model Serving; RAG, embeddings and vector search; Azure AI Document Intelligence; REST APIs and managed file transfer; EDI integration concepts; Terraform; CI/CD and DevSecOps; security, encryption, masking, privacy, monitoring and observability.

• 15+ years of experience in data architecture, data engineering, data warehousing or enterprise analytics.
• Proven experience architecting enterprise data platforms using Azure Databricks and modern Lakehouse patterns.
• Strong expertise in data governance, security, MDM, semantic modelling and cloud-data integration.
• Experience enabling BI, analytics, AI/ML and generative-AI workloads on governed data platforms.
• Bachelor’s or master’s degree in Computer Science, Information Technology, Data Engineering or a related discipline.
• Azure and/or Databricks architecture or engineering certifications are preferred.

• Strong Insurance domain experience, including regulated and privacy-sensitive data environments.
• Benefits Management experience covering benefits, enrollment, eligibility, policy, carrier and claims data.
• Familiarity with insurance data exchange and EDI concepts is preferred.

Strong architecture governance, technical decision-making, stakeholder management and communication skills; ability to translate complex requirements into scalable solutions, lead distributed engineering teams and balance strategic architecture with delivery priorities.