Overview
We are seeking a skilled Data Engineer to join a data migration program working with a fast-scaling European digital infrastructure provider. In this role, you will play a crucial part in consolidating multiple operational systems into a single target platform, working collaboratively with the Data Workstream Lead, business subject matter experts (SMEs), and application teams.
Responsibilities
- Design and build ETL/ingestion pipelines using Microsoft Fabric or equivalent Azure tools.
- Implement source-to-target mappings and transformation logic for data migration.
- Own data validation, reconciliation, and defect resolution throughout migration test cycles.
- Build reusable migration frameworks, including ingestion pipelines and validation routines.
- Support CI/CD, Git-based release processes using Azure DevOps.
Requirements
- Proven experience in data engineering, integration, or migration projects.
- Hands-on experience with Azure Data Factory, Fabric Data Factory, or Synapse Pipelines.
- Strong SQL skills for profiling, transformation, validation, and reconciliation.
- Familiarity with PySpark or Spark SQL notebooks (Databricks or Fabric).
- Demonstrated experience in end-to-end data migration projects.
- Experience with Microsoft Fabric is a bonus; a strong Azure Databricks/Synapse background is welcomed.
- Knowledge of Microsoft Purview, Delta Lake architecture, and Azure DE Associate or Databricks certification is desirable.