Overview
We are seeking an experienced Azure Data Engineer for a 6-month remote contract focusing on a major public sector organization's data and analytics programme. The role involves collaboration within a multidisciplinary team to design and implement cloud-based data solutions that enhance decision-making through access to high-quality data. The ideal candidate will leverage their expertise in Azure technologies to contribute to innovative data strategies and products.
Responsibilities
- Design, build and maintain scalable data pipelines and engineering solutions.
- Develop and optimise Azure-based data platforms and services.
- Support the ingestion, transformation and management of structured and unstructured datasets.
- Build robust ETL and ELT processes for analytics and reporting.
- Collaborate with data scientists, analysts, architects and stakeholders to fulfil data needs.
- Enhance enterprise data models and architecture artefacts.
- Manage and optimise cloud-based data storage solutions.
- Ensure adherence to data quality, integrity, governance and security standards.
Requirements
- Proven experience as a Data Engineer in complex data environments.
- Strong expertise in designing and developing Azure-based data solutions.
- Hands-on experience with Azure Databricks, Azure Data Lake, and Azure Data Platform technologies.
- Excellent SQL and data transformation skills.
- Experience building scalable ETL/ELT pipelines with large datasets.
- Understanding of data governance, quality and metadata management.
- Strong analytical and problem-solving abilities.
- Effective communication and stakeholder engagement skills.