Overview
We are seeking a Senior Data Engineer with advanced AI Engineering experience for an initial three-month contract, likely to extend. This role involves a combination of on-site and remote work, with an emphasis on developing robust data pipelines and machine learning models in a secure environment, necessitating active SC or DV clearance. You will collaborate with a team to drive AI services and ensure data integrity throughout the project lifecycle.
Responsibilities
- Develop and implement machine learning data and feature engineering processes.
- Design and build training, feature, and inference pipelines to ensure accurate data for models.
- Create feature stores and ML data models to maintain consistency across training and production environments.
- Lead the design and development of data pipelines for AI services.
- Monitor data quality and lineage for the ML pipelines.
- Conduct code and design reviews to uphold engineering standards.
- Establish evaluation and testing protocols in ML and AI pipelines to ensure quality and compliance.
Requirements
- Demonstrated expertise in building LLM and RAG services using diverse AI models.
- Strong background in Data Engineering with a keen interest in AI development.
- Proven experience in rapid prototyping with structured and unstructured data types.
- Familiarity with feature stores, vector databases, and modern evaluation frameworks.
- Experience deploying solutions on cloud platforms and Kubernetes ecosystems.
- Proficient in building production data pipelines using Python and SQL.
- Knowledge of MLOps tooling and CI/CD for machine learning applications.
- Experience mentoring engineers or working in secure environments.