Overview
We are seeking a Senior Data Engineer specializing in Databricks to contribute to a high-impact rail infrastructure program. The successful candidate will work within a leading consultancy and engage with a major transport operator, focusing on modernizing data infrastructure through real-time streaming solutions. This role includes influencing senior stakeholders and mentoring teams to foster technical excellence in data engineering.
Responsibilities
- Define and lead data architecture for real-time streaming solutions.
- Shape and implement data strategy aligned with business objectives.
- Influence and engage senior stakeholders with thought leadership on data-driven decision-making.
- Mentor and guide engineering teams, ensuring adherence to best practices.
- Drive innovation in data engineering frameworks and processes.
- Collaborate with cross-functional teams to optimize data solutions.
Requirements
- Extensive experience with Databricks, particularly in streaming data pipelines.
- Strong understanding of real-time telemetry data.
- Solid background in Azure cloud services.
- Proven ability to handle large-scale, fast-moving datasets in production environments.
- Experience in a consultancy role delivering complex data solutions for enterprise clients.
- Strong communication and mentorship skills to engage teams and stakeholders effectively.