Senior Data Engineer

Overview

We are seeking multiple Senior Data Engineers for a major data transformation and migration programme in the London Market and specialty insurance sector. The successful candidates will work across various workstreams focused on Delegated Authority Data Migration, Data Quality & Validation Migration Testing, and Portfolio Solutions & Bordereaux Processing. Candidates must possess extensive experience with insurance data and will engage with diverse teams to ensure the successful migration and validation of crucial data assets.

Responsibilities

  • Support the migration of Delegated Authority data from legacy systems to new ecosystems including validation and reconciliation.
  • Assist in migration testing cycles, including UAT, and preparing cutover processes.
  • Investigate data issues and validate that migrated data is production-ready.
  • Engineer solutions to standardise complex bordereaux data from multiple sources.
  • Develop reusable ingestion processes and map inconsistent source data into structured models.
  • Implement data quality frameworks and controls throughout the migration process.
  • Collaborate with various stakeholders including business, technology, vendors, and consultancy teams.

Requirements

  • Extensive experience in the insurance domain, specifically with London Market or specialty insurance data.
  • Strong proficiency in SQL and Python for data engineering tasks.
  • Demonstrated experience with ETL/ELT processes and data migration techniques.
  • Familiarity with source-to-target validation and data reconciliation methods.
  • Knowledge of structured and semi-structured data handling, particularly in data lake/lakehouse architectures.
  • Experience with Azure, Databricks, PySpark, and Azure Data Factory.
  • Ability to manage complex mappings and messy legacy data while engaging with multiple stakeholders.
OIR35+ members get up to 48 hours' priority access to new jobs
SkillsData Engineer, SQL, Python, ETL, Azure, Databricks, Azure Data Factory
LocationLondon Area
TypeOn-site
Rate
£600/day
PostedNEW