Azure Data Engineer

Overview

The Azure Data Engineer will play a vital role in a significant program within the public sector, focusing on building scalable data pipelines and data lake architectures in Azure Databricks. The contractor will collaborate with a team of IT professionals and will leverage technologies such as Python, PySpark, SQL, Azure Data Factory, and Microsoft Fabric to deliver effective data engineering solutions. This is an opportunity to contribute to impactful projects while working fully remote within the UK.

Responsibilities

• Build scalable data pipelines across Azure Databricks.
• Develop and implement data lake architecture.
• Utilize Python, PySpark, and SQL for data processing and analytics.
• Integrate Azure Data Factory and Microsoft Fabric into data workflows.
• Collaborate with stakeholders to deliver data engineering projects.

Requirements

• Proven experience as an Azure Data Engineer in the UK public sector.
• Strong skills in Python, PySpark, SQL, Azure Data Factory, and Microsoft Fabric.
• Demonstrated ability to deliver data engineering projects.
• Eligibility to obtain SC Clearance and must not require sponsorship.
• Availability to start with a notice period of no more than two weeks.