Overview
The Lead Fabric Data Engineer will play a crucial role in guiding the migration of on-premises SQL Server data workloads into Microsoft Fabric, ensuring a secure and well-governed data platform. Collaborating with the Central Data Team and external partners, the contractor will focus on creating sustainable data engineering practices, including the establishment of reusable reporting and analytics foundations. This position demands hands-on experience and a strong focus on deliverables, aiming to enhance existing data architectures with scalable solutions.
Responsibilities
- Evaluate and assess existing databases, stored procedures, SSIS/ETL processes, and data dependencies.
- Create a sequenced migration backlog and validation approaches to facilitate data transfer.
- Build secure ingestion patterns for data migration into Microsoft Fabric.
- Establish Bronze, Silver, and Gold data layers in OneLake using Delta tables.
- Utilize dbt Core for modular transformation models and documentation.
- Implement data governance practices, including access controls and data quality rules.
- Deliver analytics models and trusted datasets for use in Power BI.
- Mentor the internal team, providing training and technical documentation.
Requirements
- Extensive experience with the Microsoft Fabric ecosystem, including OneLake and Data Factory.
- Strong hands-on knowledge of dbt Core and CI/CD deployment processes.
- Proven ability to migrate from SQL Server to Azure or Fabric, including managing legacy processes.
- Advanced SQL skills and proficiency in Python/PySpark for data engineering.
- Experience reconciling migrated data with legacy outputs pre-cutover.
- Familiarity with Power BI and semantic data modeling techniques.
- Knowledge of security frameworks like Entra ID and Microsoft Purview.
- Proficiency with GitHub and automated testing methodologies.