Overview
We are looking for a Senior Data Engineer to contribute to a major data programme aimed at transforming health data access across the UK. In this contract role, you will design and develop scalable data platforms and pipelines while collaborating with cross-functional teams, including architects and product managers. This position is suited for a hands-on engineer who enjoys tackling complex data challenges in a regulated environment.
Responsibilities
- Design, build and maintain scalable data pipelines and data integration solutions.
- Develop and optimise data ingestion, transformation and storage processes.
- Build and support cloud-based data platforms that enable secure access to health and research data.
- Implement data quality, validation and monitoring processes to ensure data reliability.
- Integrate data from multiple internal and external sources.
- Collaborate with product managers and analysts to define requirements and deliver efficient solutions.
- Support the implementation of governance, privacy and security measures for data solutions.
- Participate in agile delivery activities, including planning and technical design discussions.
Requirements
- Significant experience as a Data Engineer with expertise in data platforms and pipelines.
- Strong proficiency in Python and SQL.
- Experience building and maintaining ETL/ELT processes.
- Familiarity with cloud-based data platforms such as AWS, Azure, or GCP.
- Knowledge of modern data architecture and management principles.
- Experience working with large and complex datasets.
- Understanding of data quality, governance, and monitoring practices.
- Ability to thrive in an agile delivery environment.