Senior Data Engineer

Overview

Senior Data Engineer - Python, SQL, Airflow, Redshift, Snowflake I've partnered with a high-growth start-up looking to expand their Data function, by bringing on a Senior Data Engineer on a contract basis - more info below: Senior Data Engineer: Tech stack - Python, SQL, ETL Pipelines, Airflow, BigQuery, Redshift, Snowflake, AWS/GCP Experience with event-stream and micro-batching data Experienced in Data Quality Assurance Experience with Data Warehouse Modelling Hybrid working in Central London - Monday in the office is essential Pays £450-£500 p/d Outside IR35 3-month initial engagement Senior Data Engineer - Python, SQL, Airflow, Redshift, Snowflake

Responsibilities

• Design and implement ETL pipelines to process large datasets.
• Develop and maintain data quality assurance protocols.
• Collaborate with cross-functional teams to improve data warehouse modeling.
• Manage event-stream and micro-batching data processes.
• Utilize AWS/GCP tools to enhance data engineering efforts.
• Optimize data storage solutions using Redshift and Snowflake.

Requirements

• Proven experience as a Data Engineer with expertise in Python and SQL.
• Strong knowledge of data pipeline tools such as Airflow and BigQuery.
• Experience with data warehouse technologies, particularly Redshift and Snowflake.
• Familiarity with AWS and/or GCP services.
• Demonstrated ability in data quality assurance and modeling.
• Experience in event-stream and micro-batching data processes.