Senior Data Engineer

Overview

We are seeking a Senior Data Engineer on a contract basis to enhance and optimize data pipelines within a Databricks Lakehouse environment. This role, which requires working one day a week on-site, involves collaborating with a high-impact team to ensure the delivery of clean, scalable, and high-quality data for analytics and reporting. The position is available for an initial 7-month period with the possibility of extension, focusing on a greenfield project.

Responsibilities

• Design, build, and optimise data pipelines using ELT/ETL best practices.
• Migrate and transform data into a Databricks Lakehouse architecture.
• Ensure data quality, reliability, and scalability for analytics and reporting.
• Collaborate with stakeholders to deliver robust solutions aligned with business needs.
• Support production environments and troubleshoot performance issues.

Requirements

• 7+ years of experience in Data Engineering with expertise in cloud-based data platforms.
• Proven ability to design and optimize pipelines for large-scale data processing.
• Hands-on experience with Databricks and Azure.
• Proficient in tools such as DBT, Python, PySpark, and SQL.