Overview
We are looking for a highly skilled Data Engineer to support a major Records Management System (RMS) replacement program within a prominent public-sector organization. The successful candidate will design, develop, and maintain scalable data pipelines to facilitate large-scale data migration and integration, working closely with solution architects and vendors. This role offers a hybrid working model requiring only 2-3 days onsite per month, allowing for significant contribution to a high-impact government project while enjoying flexible working conditions.
Responsibilities
- Design, develop, and optimise scalable ETL/ELT pipelines to support data migration and integration requirements.
- Create data ingestion and transformation solutions across diverse source and target systems.
- Analyze existing datasets, schemas, and data structures for accurate mapping and migration.
- Collaborate with solution architects and vendors on data models and integration patterns.
- Lead data quality initiatives, including validation and monitoring to ensure integrity.
- Support testing phases, trial migrations, and assess production readiness throughout the project lifecycle.
- Maintain documentation of data pipelines, processes, and standards for compliance.
Requirements
- Proven experience as a Data Engineer in large-scale transformation programs.
- Expertise in ETL/ELT development, data integration, and data pipeline building.
- Strong understanding of data modelling, relational databases, and data warehousing.
- Hands-on experience with Microsoft Azure data services, including Azure Data Factory and Azure Synapse Analytics.
- Proficiency in programming languages such as Python and familiarity with ETL tooling and API integrations.
- Experience in data migration projects with a focus on data quality and governance.
- Active NPPV 3 security clearance or potential to obtain it is desirable, particularly for candidates from public sector environments.