Overview
The Artificial Intelligence Lead will spearhead the design, development, and operationalization of AI capabilities within the Data team of a major energy company. Focusing on creating a Sales Call Quality Assurance solution using large language models (LLMs), this role will drive architectural consistency while enhancing team skill sets in AI technologies. This is a contract role with a focus on building scalable AI solutions, largely performed in a remote capacity.
Responsibilities
- Evaluate LLM model options and recommend the preferred approach.
- Tune models and optimise prompts to improve accuracy.
- Implement continuous monitoring for performance, drift, and cost, with alerting integrated into existing tools.
- Lead deployment and integration of models into production.
- Design a scalable, repeatable architecture for multiple AI use cases.
- Ensure the design supports the Sales QA solution while minimising technical debt.
- Provide model-strategy recommendations based on use case requirements.
- Enable team members to replicate the development approach for future LLM use cases.
Requirements
- Hands-on experience building and deploying LLM or generative AI solutions in production.
- Strong understanding of model selection, fine-tuning, prompt engineering, and evaluation methods.
- Proficient in Python, SQL, dbt, and Airflow.
- Familiar with LangChain for prompt management.
- Experience with Snowflake Cortex and AWS Bedrock platforms.
- Ability to evaluate costs and performance advantages of models.
- Knowledge of data security and governance practices for handling PII data.