Overview
The Data Engineer role involves participating in a transformative data programme for a leading London Market insurer, focusing on building and optimizing enterprise-scale data solutions. The contractor will collaborate with a high-profile team to design a modern data platform using Azure and Databricks, playing a vital part in the organization's data strategy. Candidates are expected to have significant experience in a data engineering context, particularly in the insurance sector.
Responsibilities
- Design and build enterprise-scale data solutions within Azure environments.
- Optimize data workflows to enhance performance and efficiency.
- Collaborate with cross-functional teams to support data transformation initiatives.
- Implement Medallion Architecture principles in data project designs.
- Utilize advanced SQL and Python/PySpark for data processing and engineering tasks.
- Contribute to the ongoing evolution of the modern data platform.
Requirements
- Proven experience in data engineering, particularly within Azure ecosystems.
- Hands-on expertise in designing and building enterprise data platforms.
- Proficiency in Azure Databricks and Medallion Architecture.
- Advanced knowledge of SQL and strong development skills in Python/PySpark.
- Demonstrable experience in the insurance industry, with specific knowledge of London Market practices being highly desirable.