Overview
The CRO/Optimization Engineer will play a pivotal role in shaping the measurement, testing, and optimization processes for AI-powered products in a commercial setting. Working closely with cross-functional teams, the contractor will be responsible for the delivery of experimentation initiatives and ensure that product changes align with critical business outcomes. This role will focus on bridging traditional optimization methods with innovative AI product development to enhance customer experiences.
Responsibilities
- Build, instrument and deliver experiments across live digital and AI-powered products.
- Extend and manage feature flagging capabilities using LaunchDarkly or similar platforms.
- Configure, validate, and troubleshoot experiment tracking, analytics instrumentation, and event collection.
- Define and review event schemas, data layer specifications, and tracking requirements, including AI-related metadata.
- Collaborate with analytics and senior stakeholders to evaluate the commercial impact of product changes.
- Support experimentation across conversational agents, AI advisors, and LLM-powered experiences.
Requirements
- Strong hands-on experience delivering experiments in production environments.
- Practical experience with LaunchDarkly or comparable feature flag management platforms.
- Working knowledge of experimentation platforms such as Adobe Target or Optimizely.
- Experience with AI or LLM-powered products and intelligent customer journeys.
- Strong understanding of analytics implementation, event tracking, and experimentation measurement.
- Ability to operate independently in a remote, cross-functional environment.
- Exposure to Microsoft Azure and Azure AI services is beneficial.
- Familiarity with AI architectures such as RAG or multi-agent workflows is advantageous.