Overview
We are seeking a Senior Data Platform Engineer to contribute to our data engineering initiatives on a 6-month contract, working in a hybrid model with a mix of on-site and remote days. The successful candidate will collaborate with a team to design, build, and optimize scalable data pipelines and lakehouse solutions using modern AWS technologies.
Responsibilities
- Design and develop scalable data pipelines and lakehouse architectures.
- Optimize existing data pipelines for performance and reliability.
- Utilize AWS services to implement data solutions effectively.
- Collaborate with cross-functional teams to gather requirements and deliver solutions.
- Ensure data quality and integrity throughout the architecture.
- Implement best practices for data governance and security.
Requirements
- Proven experience as a Data Platform Engineer or in a similar role.
- Strong knowledge of data lakehouse architectures, particularly with Iceberg.
- Proficiency in PySpark and DBT for data transformation and processing.
- Experience with AWS services relevant to data engineering.
- Demonstrated ability to build and maintain data pipelines in a cloud environment.
- Familiarity with data governance and compliance standards.