Overview
The Lead Data Engineer will take charge of evaluating and potentially guiding the consolidation of a fragmented data landscape into a unified Google BigQuery platform for a data-driven organization. This role focuses on assessing existing data architectures, validating migration strategies, and establishing scalable solutions while collaborating closely with senior leadership to ensure alignment with business objectives.
Responsibilities
- Conduct a thorough assessment of the current data architecture and reporting landscape.
- Identify architectural risks, bottlenecks, and migration challenges.
- Validate the feasibility of migrating critical data pipelines to Google BigQuery.
- Develop a comprehensive roadmap for data consolidation.
- Establish frameworks for ensuring data integrity and consistency post-migration.
- Deliver executive recommendations including a migration feasibility assessment and cost-benefit analysis.
- Participate in hands-on technical analysis and validation of existing pipelines.
Requirements
- Proven track record in leading large-scale data platform migrations and consolidation initiatives.
- Deep knowledge of Google BigQuery architecture and best practices.
- Experience with a range of cloud data platforms including Snowflake and Microsoft Fabric.
- Expertise in designing scalable, enterprise-grade data architectures.
- Familiarity with modern data engineering tools and practices such as dbt.
- Strong analytical mindset and problem-solving skills.
- Ability to navigate complex data environments and propose practical solutions.