Overview
We are seeking a Data Engineer to contribute to large-scale data transformation projects aimed at developing a modern, production-ready data platform. In this hybrid role, you will collaborate with architects and engineers to build scalable data solutions, enhance existing environments, and ensure high-quality delivery of project milestones. You will have a significant influence on the technical direction and success of the platforms you work on.
Responsibilities
- Design, build and optimise scalable data pipelines across the AWS data platform.
- Identify and resolve technical debt to modernise the existing environment.
- Collaborate with client engineering teams, sharing knowledge and promoting best practices.
- Support the successful delivery of migration milestones and platform improvements.
- Work with the Solution Architect to implement the target data architecture.
- Troubleshoot, enhance and stabilise the platform for production workloads.
Requirements
- Strong hands-on experience with the AWS data ecosystem, including S3, Glue, Redshift, and Lake Formation.
- Solid understanding of Lakehouse architecture and modern data platform design.
- Proficiency in Python and SQL development.
- Experience in building and maintaining data pipelines within complex environments.
- Ability to collaborate effectively with both internal and client engineering teams.
- Experience in regulated or high-volume data environments, particularly in industries like Gambling/Gaming, Betting, or Financial Services.