Data Engineer

Overview

As a Data Engineer, you will work remotely with a dynamic team on a cutting-edge Microsoft Fabric build for a client in the education sector. Your primary focus will be on building and maintaining data pipelines and models that support reporting and AI functionalities, while collaborating with other engineers to augment your skills and contribute to active projects.

Responsibilities

  • Build and maintain data pipelines and models using Microsoft Fabric and Snowflake.
  • Develop data processing solutions in Python notebooks and SQL.
  • Implement data modeling techniques including medallion architecture and dimensional modeling.
  • Test and review code changes through pull requests.
  • Prepare data for custom applications and generate reports.
  • Utilize AI coding assistants to enhance code development and reliability.
  • Collaborate with the team to improve processes and share knowledge on best practices.

Requirements

  • Proven experience with Microsoft Fabric and/or Snowflake.
  • Strong SQL and Python skills for data processing, including libraries such as pandas, polars, or PySpark.
  • Familiarity with medallion architecture and dimensional modeling, including slowly changing dimensions.
  • Experience using Git for version control, including pull requests and code reviews.
  • Hands-on experience with AI coding assistants like Claude Code or GitHub Copilot.
  • Experience deploying pipelines or models into production environments.