AI Lead

Role Overview

The candidate must have strong applied AI experience, proven production delivery, and the ability to establish reliable evaluation frameworks that measure accuracy, detect hallucinations, validate citations, and protect sensitive information.

Key Responsibilities

• Design document-AI architecture and select models and platforms within WBG-approved options.

• Lead development of OCR, document extraction, classification, summarisation, RAG, and AI-assisted drafting pipelines.

• Define evaluation frameworks covering extraction accuracy, answer quality, hallucination rates, and citation correctness.

• Build and maintain evaluation datasets with verified ground-truth answers.

• Implement responsible-AI controls, PII protection, data-sensitivity safeguards, and secure access.

• Expose AI services through APIs for integration with J2, J4, and J5.

• Review AI-generated code and enforce security, quality, and production-readiness standards.

• Lead technical decisions, troubleshoot production issues, and improve AI quality using evaluation results.

• Collaborate with OutSystems and platform teams to deliver reliable document-intelligence capabilities.

Mandatory Skills & Experience

• 8+ years of overall experience, including 3+ years in applied AI.

• At least 1.5 years building GenAI or document-AI solutions.

• Proven experience building and shipping RAG, AI agents, or document-AI solutions to production.

• Strong knowledge of LLMs, such as Azure OpenAI, OpenAI API, or equivalent.

• Hands-on experience with document extraction, OCR, RAG, summarisation, or GenAI drafting.

• Python programming and API development/integration experience.

• Understanding of embeddings, vector databases, and retrieval pipelines.

• Experience creating evaluation datasets and defining measurable AI-quality metrics.

• Ability to evaluate extraction accuracy, detect hallucinations, and verify citations against source documents.

• Knowledge of responsible AI, security, PII handling, and data-sensitivity controls.

• Technical leadership experience, including architecture decisions and code-quality reviews.

Preferred Skills

• Azure OpenAI and Azure AI services.

• LangChain or equivalent LLM orchestration frameworks.

• OutSystems AI Agent Builder.

• API-based integration with OutSystems applications.

• Enterprise document intelligence experience in procurement, public-sector, or regulated environments.

• Demonstrable improvements in document-processing accuracy, drafting quality, or processing time.