Overview
The Senior Data Engineer will join a dynamic data team focused on developing and implementing scalable data solutions that enhance analytics and decision-making for a global streaming and digital platform. Working in a hybrid environment, the Engineer will collaborate with various stakeholders to tackle data challenges and foster best practices in data management, using modern cloud technologies and large datasets.
Responsibilities
- Design and build scalable data models and distributed ETL pipelines using big data technologies.
- Collaborate with stakeholders to translate data challenges into technical solutions.
- Champion DataOps principles and engineering best practices.
- Develop and optimise data solutions utilizing Google BigQuery, Python, SQL, and DBT.
- Mentor and support fellow engineers to improve team performance.
- Work within Agile teams to deliver successful projects.
- Promote best practices in data governance and architectural consistency.
- Onboard new data sources and enhance data quality and integration processes.
Requirements
- Strong experience in designing complex data models and large-scale data pipelines.
- Advanced SQL skills with experience in optimising large datasets.
- Proven experience in software and data engineering, including CI/CD practices.
- Experience in delivering cloud-based data warehousing and ETL solutions.
- Strong knowledge of Google Cloud Platform (GCP) and DBT.
- Solid understanding of data modelling and reporting architectures.
- Experience in troubleshooting data platform incidents.
- Degree in Computer Science, Software Engineering, or related discipline.