Overview
We are seeking a skilled Azure Data Engineer to support a critical data warehouse migration project within a respected housing association. The successful candidate will work within a dynamic team, focusing on designing, developing, and implementing data solutions using Azure cloud services while contributing to a significant digital transformation initiative. This is a contract role offering flexible hybrid working options and is initially set for six months, with potential for extension based on project needs.
Responsibilities
- Design and develop scalable data pipelines and workflows using Azure Data Factory and Azure Databricks.
- Implement data migration strategies for transitioning existing data warehouses to Azure cloud infrastructure.
- Write efficient Python scripts for data transformation, automation, and integration tasks.
- Collaborate with data analysts, project managers, and stakeholders to understand data requirements.
- Ensure data security, compliance, and best practices are maintained throughout the project lifecycle.
- Monitor system performance and troubleshoot issues to ensure high availability of data services.
- Document technical specifications and provide knowledge transfer to internal teams as needed.
Requirements
- Strong technical background in Azure cloud services with proven experience in data engineering.
- Solid expertise in Azure Data Factory and Azure Databricks; familiarity with Azure Synapse Analytics is advantageous.
- Proficiency in Python programming for data processing and automation tasks.
- Excellent communication and collaboration skills to work effectively within a team environment.
- Proactive attitude with a desire to contribute to team culture and organizational goals.
- Ability to work independently and manage tasks efficiently within project timelines.
- Full, independent right to work in the UK without sponsorship requirements.