Overview
The Data Engineer will join a multidisciplinary team focused on developing a large-scale cloud data platform. This role involves working throughout the data lifecycle, including data collection, processing, and governance, with a strong emphasis on delivering solutions in Azure. The Engineer will also contribute to architectural decisions and best practices while handling complex data, particularly in geospatial contexts.
Responsibilities
- Develop and evolve a cloud-based data platform.
- Shape data collection, processing, governance, and consumption processes.
- Contribute to architectural decisions and engineering best practices.
- Process complex location-based datasets.
- Deliver data engineering solutions using Azure technologies.
- Implement automated data pipelines for data processing.
Requirements
- Proven experience delivering data engineering solutions in Azure.
- Hands-on expertise with Azure Databricks.
- Familiarity with geospatial, mapping, or location intelligence datasets.
- Experience working with central UK government projects within the past 5 years.
- Strong programming skills in Python and SQL.
- Experience in building and maintaining automated data pipelines.