Overview
We are seeking a Senior Data Engineer to join a dynamic team within the insurance sector, focusing on the delivery of a data and analytics platform using Microsoft Fabric. This hands-on role involves independently managing workstreams, as well as mentoring a junior team member, while engaging with senior stakeholders to ensure successful project outcomes.
Responsibilities
- Build new ingestion pipelines in Microsoft Fabric using Python (PySpark) notebooks.
- Model data for consumption in Power BI through a dimensional gold warehouse layer and a semantic model.
- Improve platform performance through optimization strategies.
- Collaborate across cross-functional areas such as logging, monitoring, and data governance.
- Engage with senior stakeholders to independently run and manage workstreams with minimal supervision.
- Scope, plan, and deliver projects while maintaining strong client relationships.
Requirements
- Strong experience in building data pipelines.
- Proficient in SQL and Python/PySpark.
- Familiarity with the Azure data ecosystem.
- Understanding of medallion architecture and dimensional modelling techniques.
- Evidence of independently owning and delivering workstreams.
- Experience in scoping and planning deliverables.
- Client-facing skills with the ability to manage stakeholder expectations effectively.