Overview
The Cloud Engineer will work on a 6-month contract basis with potential for extension, providing expertise in cloud-based data solutions to enhance client projects within a well-respected AI consultancy. Collaborating with a team of data professionals, the contractor will contribute to the design and implementation of data strategies and platforms, working closely with clients to maximize the value of their data assets.
Responsibilities
- Develop scalable data pipelines for machine learning workloads.
- Implement and manage cloud data platforms using Terraform and Terragrunt.
- Utilize orchestration tools such as Apache Airflow to streamline data processes.
- Design and establish data governance frameworks to protect commercial data assets.
- Collaborate with cross-functional teams to deliver innovative AI solutions.
Requirements
- Minimum of 5 years' experience in Data Engineering.
- Extensive experience with Terraform and Terragrunt for deploying data platforms, preferably Databricks.
- Strong background in designing scalable data pipelines for machine learning.
- Familiarity with orchestration tools like Apache Airflow or similar.
- Knowledge of data modeling and dimensional modeling principles in data warehousing.