Overview
We are seeking Data Engineers on a contract basis to develop and maintain data pipelines for a large regulated organization in the UK, utilizing Snowflake. In this role, you will collaborate with other engineers to ensure the efficient movement and transformation of data, primarily focusing on building scalable solutions in a hybrid environment. You will work with both streaming data and traditional data workflows, incorporating modern development tools into your processes.
Responsibilities
- Build and maintain data pipelines feeding Snowflake.
- Model and transform data using dbt.
- Handle streaming data using Kafka.
- Write clean, tested Python and SQL code for reliability.
- Collaborate with team members on data engineering best practices.
- Implement AI-assisted development tools in daily workflow.
Requirements
- Strong proficiency in Python and SQL.
- Hands-on experience with dbt for data transformation.
- Practical experience developing data pipelines with Snowflake.
- Familiarity with Kafka or event streaming concepts.
- Comfortable using AI-assisted tools, such as GitHub Copilot.
- Experience in regulated environments is a plus.
- Knowledge of AWS services is advantageous.