Overview
The Senior Data Engineer (Databricks) will join a specialist data and AI consultancy engaged with a prominent technology-driven financial services organization. This role focuses on enhancing the design, development, and operation of data solutions within their Databricks environment, combining hands-on engineering expertise with technical leadership to drive modern development practices and mentor a team of engineers.
Responsibilities
- Design and implement data solutions using Databricks.
- Write production-quality code and contribute to engineering tasks.
- Enhance CI/CD processes and deployment practices.
- Support metadata management and ensure operational reliability.
- Make technical design decisions and establish scalable solutions.
- Mentor existing engineers and provide technical guidance.
- Introduce modern engineering practices and challenge existing methods.
- Communicate technical decisions and collaborate with stakeholders.
Requirements
- Proven experience with Databricks in a hands-on data engineering capacity.
- Experience in building and maintaining robust data pipelines and using tools like dbt.
- Strong understanding of CI/CD, deployment automation, and engineering best practices.
- Ability to contribute to solution architecture while remaining involved in development.
- Experience in mentoring engineers and leading technical discussions.
- Strong communication skills for engaging with technical and non-technical stakeholders.
- Proactive and adaptable mindset focused on improving engineering operations.
- Background in fintech, SaaS, or digital-native businesses is a plus.