Overview
We are seeking two Data Engineers for a 6-month contract position that has a high likelihood of extension. The successful candidates will be integral to a leading AI consultancy, working on innovative data strategies and cloud data solutions using the Databricks platform, with a focus on delivering impactful results for clients.
Responsibilities
- Develop scalable data pipelines for machine learning workloads.
- Implement and manage cloud-native data platforms using Databricks.
- Design data strategies and governance frameworks to optimize data use.
- Utilize orchestration tools like Apache Airflow for workflow management.
- Collaborate with cross-functional teams to understand data needs and requirements.
- Ensure data quality and integrity throughout the engineering processes.
- Maintain documentation of data engineering processes and architectures.
Requirements
- Minimum of 5 years' experience in Data Engineering.
- Extensive experience with the Databricks platform.
- Proven experience in building cloud-native data platforms.
- Strong knowledge of data modeling and dimensional modeling principles.
- Experience with orchestration tools such as Apache Airflow or equivalent.
- Familiarity with data warehousing concepts and practices.
- Ability to work in a hybrid environment and adapt to client needs.