Overview
The Senior Data Migration Engineer will join a dynamic data engineering team within a fast-growing UK retailer, focusing on critical data migration and integration projects. This hands-on role is ideal for an experienced data engineer who excels in managing complex data challenges and is passionate about enhancing the organization's data landscape through innovative technical solutions. The engineer will closely collaborate with cross-functional teams to design and implement scalable data pipelines, ensuring data accuracy and quality throughout various migration phases.
Responsibilities
- Design and build scalable data migration and transformation pipelines.
- Conduct data profiling, mapping, extraction, transformation, loading, and validation.
- Develop source-to-target mappings and transformation logic, addressing data quality issues.
- Implement reconciliation and quality control measures for migrated data.
- Collaborate with data engineers, software engineers, architects, and product teams.
- Produce technical documentation covering data flows, mappings, and migration processes.
- Identify opportunities for improvement within the data engineering estate.
- Investigate performance and data quality issues to determine root causes.
Requirements
- Significant experience in data migration and transformation projects.
- Strong SQL skills for developing scalable data pipelines and processes.
- Familiarity with modern cloud data platforms: AWS, Azure, or GCP.
- Experience with data technologies such as Databricks, Apache Spark, or Airflow.
- Proficiency in Python and strong understanding of data modelling.
- Ability to work independently and manage complex technical problems.
- Prior experience in retail, e-commerce, or high-volume customer environments is advantageous.
- Capability to produce clear technical documentation for various stakeholders.