Senior Data Engineer

Overview

We are seeking a Senior Data Engineer for a 12-month engagement, operating under an outside IR35 contract with a flexible, hybrid working pattern. The successful candidate will have the opportunity to shape modern data platforms, tackle complex engineering challenges, and deliver impactful data solutions. Collaborating with a diverse team, you will play a critical role in building scalable data products that support analytics, AI, and operational decision-making.

Responsibilities

  • Design, build, and maintain scalable data products and pipelines.
  • Own solutions from requirements gathering through to deployment and monitoring.
  • Develop cloud-native data platforms using modern engineering practices.
  • Improve platform performance, resilience, security, and cost efficiency.
  • Implement data quality, observability, and governance controls.
  • Collaborate with stakeholders to translate business requirements into technical solutions.
  • Contribute to CI/CD, infrastructure-as-code, and automation initiatives.
  • Mentor engineers and champion data engineering best practices.

Requirements

  • Strong software engineering fundamentals including Python, Scala or Java, SQL, Git, testing, APIs, and CI/CD.
  • Experience building modern cloud-based data platforms within AWS, Azure, or GCP.
  • Strong knowledge of technologies such as Databricks, Snowflake, Spark, Kafka, dbt, Airflow, or Azure Data Factory.
  • Experience designing and delivering end-to-end data engineering solutions.
  • Understanding of distributed computing, data partitioning, optimization, and large-scale data processing.
  • Production mindset with experience in monitoring, security, data quality, resilience, and operational support.
  • Ability to balance technical excellence with pragmatic decision-making.
  • Desirable experience developing lakehouse or modern data warehouse architectures, knowledge of infrastructure-as-code tools such as Terraform, and exposure to machine learning or advanced analytics environments.
OIR35+ members get up to 48 hours early access to new jobs
SkillsData Engineering, CI/CD, Machine Learning
TechnologiesCloud Native, Python, Scala, Java, SQL, AWS, Azure, GCP, Databricks, Snowflake
LocationCity Of London
TypeHybrid
PostedNEW