Senior Data Engineer

Overview

Senior Data Engineer - Python, SQL, Airflow, Redshift, Snowflake I've partnered with a high-growth start-up looking to expand their Data function, by bringing on a Senior Data Engineer on a contract basis - more info below: Senior Data Engineer: Tech stack - Python, SQL, ETL Pipelines, Airflow, BigQuery, Redshift, Snowflake, AWS/GCP Experience with event-stream and micro-batching data Experienced in Data Quality Assurance Experience with Data Warehouse Modelling Hybrid working in Central London - Monday in the office is essential Pays £450-£500 p/d Outside IR35 3-month initial engagement Senior Data Engineer - Python, SQL, Airflow, Redshift, Snowflake

Responsibilities

• Develop and optimize ETL pipelines using Python and SQL.
• Implement data quality assurance practices to ensure data integrity.
• Work with cloud technologies such as AWS and GCP for data management.
• Design and model data warehousing solutions using Redshift and Snowflake.
• Collaborate with team members on event-stream and micro-batching data workflows.
• Participate in hybrid work arrangements with regular office days.

Requirements

• Proven experience as a Data Engineer with a strong focus on Python and SQL.
• Hands-on experience with Airflow, BigQuery, Redshift, and Snowflake.
• Familiarity with data quality assurance methodologies and data warehouse modeling.
• Experience working with cloud platforms like AWS and GCP.
• Demonstrated ability to develop and maintain ETL pipelines.
• Understanding of event-streaming and micro-batching frameworks is preferred.