Overview
The Senior Data Engineer will serve as the expert in Databricks for a leading consultancy, advising clients ranging from engineering teams to senior stakeholders. This role focuses on designing and delivering modern Lakehouse platforms while ensuring the implementation of best practices in data architecture and pipeline scalability. The position is on a 6-month contract basis, requiring deep expertise in Databricks to fulfill client needs effectively.
Responsibilities
- Act as the senior Databricks expert on client engagements.
- Lead the design and delivery of modern Lakehouse platforms.
- Advise engineering teams and senior stakeholders on best practices.
- Design and build scalable data pipelines.
- Implement Delta Sharing as part of the data architecture.
- Utilize Unity Catalog to enhance data governance and accessibility.
- Ensure adherence to Medallion Architecture principles in implementations.
- Contribute to the overall strategic vision for data solutions.
Requirements
- Deep, hands-on expertise in Databricks.
- Experience with Unity Catalog.
- Strong background in designing and building scalable data pipelines.
- Experience implementing Delta Sharing.
- Solid understanding of Medallion Architecture.
- Databricks certifications preferred.
- Ability to advise clients at all levels of the organization.