Data Engineer

Overview

The Senior GCP Data Engineer will join a major media organization tasked with assessing and improving an existing Google Cloud Platform (GCP) integration that connects operational customer data to a CRM platform. This role involves not only enhancing the current system but also potentially rearchitecting it to improve efficiency and reduce costs, all while collaborating closely with senior stakeholders.

Responsibilities

  • Assess existing GCP data integration and identify areas for improvement.
  • Implement enhancements to reduce processing time and monthly costs.
  • Optimize brownfield data pipelines for better performance.
  • Work with stakeholders to capture requirements and deliver quick wins.
  • Utilize Dataflow, Dataform, Apache Beam, and Big Query in daily tasks.
  • Document changes and improvements for future reference.

Requirements

  • Proven hands-on experience as a Data Engineer on GCP.
  • Commercial experience with Dataflow, Dataform, Apache Beam, and Big Query.
  • Strong analytical skills for assessing and improving data pipelines.
  • Demonstrated ability to achieve performance optimization and cost reduction.
  • Experience working with CRM systems, preferably Braze or similar tools.
  • Proven track record of delivering similar projects successfully in previous roles.