Overview
The Enterprise AI Architect will be responsible for leading the AI architecture workstream of a significant transformation program. This role will focus on developing a buildable architecture from an initial draft, leveraging a three-zone model to ensure safe and effective AI deployment. Collaborating with engineering teams, the architect will also evaluate AI gateway options and establish governance processes to oversee the lifecycle of AI use cases.
Responsibilities
- Review the draft architecture and deliver a detailed multi-layer design, ending in a build specification.
- Lead AI gateway evaluation and selection, considering options like LiteLLM, Kong, and Azure APIM.
- Design the request pipeline, environments, and egress controls, including agent identity in Entra ID.
- Define supply-chain controls and strategies for model provider residency and isolation.
- Build a permission-aware grounding approach ensuring AI access is restricted to authorized data.
- Own data loss prevention (DLP) policies, security specifications, and the threat model.
- Run use-case governance processes from idea to production, including the register and release gates.
- Deliver reference patterns for priority initiatives such as AI-assisted software delivery and ML routing.
Requirements
- Proven experience in enterprise architecture and Zero Trust frameworks.
- Deep knowledge of Entra ID and conditional access practices.
- Experience with egress and network controls in production environments.
- Familiarity with LLM gateways, model routing, and supply-chain controls.
- Desirable experience includes running an LLM gateway in production and conducting enterprise security reviews.
- Experience chairing design forums and technical design reviews.