Data Engineer

Overview

We are seeking a skilled Microsoft Fabric Data Engineer for an initial 6-month contract to enhance our data and AI capabilities, focusing on Fabric IQ, Retrieval-Augmented Generation (RAG), and semantic data layers. In this hybrid role, you will work closely with business stakeholders to design and deliver innovative data solutions that support intelligent business workflows. Your expertise will drive the development of scalable, AI-ready data platforms, leveraging advanced technologies and data engineering practices.

Responsibilities

  • Design, develop, and optimise enterprise-scale data solutions using Microsoft Fabric, such as Lakehouse and Medallion Architecture.
  • Build scalable ETL/ELT pipelines employing Fabric Data Factory, PySpark, SQL, and notebooks.
  • Implement Microsoft Fabric IQ capabilities for semantic modelling and AI-driven applications.
  • Develop Retrieval-Augmented Generation (RAG) solutions for structured and unstructured data.
  • Implement data ingestion and retrieval strategies to enable context-aware AI responses.
  • Create Context Engineering solutions that enrich enterprise data with defined business metadata.
  • Construct and maintain semantic data layers, including Power BI semantic models.
  • Ensure data governance, quality, and performance optimisation across the data platform.

Requirements

  • Strong hands-on experience with Microsoft Fabric components such as Lakehouse, Warehouse, and Power BI.
  • Proficiency in SQL and Python/PySpark, with a proven track record of building scalable data pipelines.
  • Familiarity with Microsoft Fabric IQ, particularly in semantic modelling and AI readiness.
  • Understanding of Retrieval-Augmented Generation (RAG) concepts, including embeddings and vector databases.
  • Background in Context Engineering for preparing enterprise data for AI applications.
  • Experience designing semantic data layers and business data models.
  • Knowledge of AI technologies such as Azure OpenAI and Microsoft Foundry is advantageous.
  • Experience with data governance, CI/CD processes, Git, and Azure DevOps.