Overview
We are seeking a Data Engineer to contribute to a significant data transformation programme aimed at enhancing data quality, performance, and scalability. This fully remote role offers the opportunity to work within a cloud-first environment, collaborating with technical and non-technical stakeholders to support critical business outcomes. The successful contractor will play a vital role in designing and implementing data migration solutions while ensuring the integrity and accuracy of migrated data.
Responsibilities
- Design, build, and enhance data migration and transformation solutions within AWS.
- Review existing data engineering solutions and identify opportunities for improvement.
- Optimise data processing workflows to increase efficiency.
- Develop logging, monitoring, and error-handling capabilities within Python applications.
- Build and maintain ETL/ELT pipelines using AWS data services.
- Validate migrated data and perform reconciliation activities.
- Investigate data issues and resolve quality concerns.
- Produce technical documentation and support deployment activities.
Requirements
- Strong commercial Python development experience, including performance optimisation and code reviews.
- Hands-on experience with AWS services, including Amazon RDS and AWS Glue.
- Proven track record in delivering data migration and transformation projects.
- Strong understanding of data integration, processing, and ETL/ELT methodologies.
- Experience in data validation, reconciliation, and quality management.
- Strong analytical and problem-solving skills.
- Ability to work autonomously in a remote-first team.
- Active SC Clearance is essential.