Overview
The Senior Data Engineer will play a crucial role in the AWS Lakehouse migration project for a client in the Gambling and Sports Betting sector. This hybrid position involves collaborating with the client's engineering team to optimize data pipelines, resolve technical issues, and ensure the platform meets production standards. The contractor will leverage their expertise in AWS data technologies, Python, and SQL to drive the project forward and support knowledge transfer.
Responsibilities
- Build and fix data pipelines to achieve a stable, production-ready state.
- Design, build, and optimise data pipelines using the AWS stack.
- Identify and resolve existing technical debt during the migration process.
- Collaborate with the client's engineering team to facilitate knowledge transfer.
- Contribute towards stabilizing the platform and achieving delivery milestones.
- Support the Architect in defining and implementing the target state of the project.
Requirements
- Extensive experience with the AWS data platform stack, including S3, Glue, Lake Formation, and Redshift.
- Strong proficiency in Python and SQL.
- Experience in regulated or high-volume data environments.
- Previous experience in the betting and iGaming industry is highly desirable.
- Ability to identify and resolve technical debt in data migration projects.
- Experience in designing and optimizing data pipelines.