About the role
- Design and own the end-to-end data governance framework for the Databricks Data Foundation platform, covering data classification, ownership, stewardship, and quality standards.
- Architect Unity Catalog for metastore structure, catalog/schema hierarchy, fine-grained access controls (RBAC/ABAC), row- and column-level security, and audit logging across the migrated estate.
- Integrate Unity Catalog with enterprise data catalog and governance tooling (e.g. Collibra, Purview, or Alation) to give Allianz a single, consistent view of data lineage, glossary, and metadata across Databricks and connected systems.
- Define and implement data lineage capture (source-to-target) to support impact analysis, audit, and regulatory reporting during and after the Synapse-to-Databricks migration.
- Partner with data engineering, security, and platform teams to embed governance controls into migration pipelines for both Phase 1 (in progress) and the upcoming Phase 2 source systems.
- Ensure the governance model satisfies insurance-sector regulatory requirements (e.g. GDPR, BCBS 239, Solvency II) and Allianz's internal data policies.
- Act as the governance subject-matter expert in Allianz Technology engagement forums, including SteerCo and status reporting, translating technical governance decisions for business and compliance stakeholders.
- Mentor engineers on governance best practices and review designs for compliance before deployment.
- 10+ years in data architecture/engineering, with at least 3-4 years focused on data governance in cloud data platforms.
- Hands-on expertise architecting and administering Databricks Unity Catalog: metastores, catalogs, access control, lineage, audit logs, and Delta Sharing.
- Proven experience integrating Databricks with enterprise data catalog/governance tools such as Collibra, Microsoft Purview, or Alation.
- Worked on Azure as hyperscaler in past project
- Has worked on Informatica earlier and understands Data Governance implementation
- Strong grounding in data governance frameworks and concepts: data stewardship, master data management, data quality, metadata management, and data lineage.
- Experience with large-scale cloud data platform migrations (Synapse, Azure Data Factory, or equivalent, to Databricks/Lakehouse architectures preferred).
- Working knowledge of regulatory and compliance frameworks relevant to insurance/BFSI (GDPR, BCBS 239, Solvency II, or similar).
- Strong stakeholder management and communication skills, with experience presenting to senior client and SteerCo audiences.
- Prior experience working within a large enterprise client engagement model (consulting/systems integrator background preferred).
- Databricks certification (e.g. Databricks Certified Data Engineer Professional, or Databricks Lakehouse/Unity Catalog specialty credentials).
- Certification or hands-on experience with Collibra, Purview, or Alation administration.
- Prior experience in insurance or broader insurance services, especially on regulatory/audit-driven data programmes.
- Familiarity with Azure cloud services beyond Synapse (Azure Data Lake, Azure Key Vault, Azure Purview).
- Experience defining governance operating models (data ownership RACI, stewardship councils, policy lifecycle).