Overview
We are seeking Data Engineers to develop and maintain data pipelines for a large regulated UK organisation, utilizing Snowflake in a high-scale environment. The successful contractors will collaborate in teams and employ advanced tools and methodologies to ensure data integrity and reliability. This position promises opportunities for engagement with emerging technologies and practices, particularly in AI-assisted development.
Responsibilities
- Build and maintain data pipelines to feed Snowflake.
- Model and transform data using dbt.
- Process streaming data with Kafka.
- Write clean, reliable Python and SQL code for data operations.
- Collaborate with team members to implement best practices in data engineering.
Requirements
- Strong proficiency in Python and SQL.
- Hands-on experience with dbt for data modeling.
- Proven experience developing data pipelines using Snowflake.
- Familiarity with Kafka or other event streaming technologies.
- Experience with AI-assisted development tools like GitHub Copilot.
- Knowledge of AWS and experience in regulated environments is a plus.