Overview
We are seeking Data Engineers to develop and maintain data pipelines for a large regulated UK organization moving their data onto Snowflake. This role involves collaboration with a team in a dynamic environment, focusing on pipeline development and data transformation. The contract is for an initial period of 3 to 6 months, with the possibility of extension, and requires occasional on-site work in various UK locations.
Responsibilities
- Build and maintain data pipelines feeding Snowflake.
- Model and transform data using dbt.
- Work with streaming data through Kafka.
- Write clean, tested Python and SQL code that adheres to best practices.
Requirements
- Proficient in Python and SQL.
- Hands-on experience with dbt.
- Real pipeline development experience with Snowflake.
- Exposure to Kafka or event streaming.
- Comfortable using AI-assisted development tools like GitHub Copilot.
- Familiarity with AWS is a plus.
- Experience in regulated environments is preferred.