Overview
As a Lead Data Engineer, you will play a crucial role in supporting a major finance transformation project, focusing on the creation of a Unified Data Platform on Google Cloud Platform (GCP). You will work closely with various engineering teams to establish data engineering standards, design scalable ingestion frameworks, and provide technical oversight throughout the project, ensuring that solutions are efficient, secure, and maintainable. This position requires a hands-on approach and expertise in GCP data engineering to deliver enterprise-scale production solutions.
Responsibilities
- Own the technical direction for data acquisition, ingestion, and source-system onboarding.
- Design and implement scalable, reusable, metadata-driven ingestion frameworks.
- Establish data engineering standards, architectural patterns, and technical guardrails.
- Lead the design of batch and incremental ingestion pipelines across multiple enterprise source systems.
- Provide technical oversight, challenge design decisions, and guide engineers through delivery.
- Ensure ingestion solutions are reliable, maintainable, secure, and scalable.
Requirements
- Strong, hands-on GCP data engineering experience delivering production solutions.
- Proven experience designing reusable, metadata-driven or configuration-driven ingestion frameworks.
- Previous Lead or Principal Data Engineer experience with ownership of technical architecture and engineering standards.
- Strong experience with Python, SQL, and enterprise ETL/ELT development.
- Experience integrating multiple source systems into cloud data platforms.
- Proven ability to establish reusable engineering patterns and production-ready delivery practices.
- Experience within financial services, insurance, or similarly regulated enterprise environments is advantageous.