Overview
This position is for a Senior Data Engineer specializing in Microsoft Fabric, aimed at supporting a consultancy in enhancing its data engineering capabilities. The contractor will engage with various clients, including those in government, construction, financial services, and healthcare, to design, build, and implement modern data platforms. The role involves significant client interaction and hands-on work in delivering data solutions tailored to diverse industry needs.
Responsibilities
- Design and implement Microsoft Fabric data platforms for external clients.
- Build Fabric Lakehouse and Warehouse solutions.
- Develop data-ingestion, transformation, and orchestration pipelines.
- Create notebooks and data-processing workloads using Python and PySpark.
- Implement medallion and layered data architectures.
- Integrate data from APIs, databases, cloud applications, and file-based sources.
- Support migrations from legacy or existing Azure platforms into Microsoft Fabric.
- Establish engineering standards covering testing, deployment, security, and governance.
Requirements
- Strong commercial experience delivering Microsoft Fabric implementations.
- Hands-on experience with Fabric Lakehouse, Warehouse, Data Factory, Data Pipelines, and notebooks.
- Strong SQL skills.
- Commercial Python or PySpark experience.
- Experience designing modern data platform or lakehouse architectures.
- Understanding of medallion architecture and reusable engineering patterns.
- Broader Microsoft Azure data experience including Azure Data Factory, Azure Data Lake, Synapse, Azure SQL, or Databricks.
- Experience delivering greenfield data platforms or migration projects.