Overview
We are seeking a hands-on Data Engineer to build and maintain robust data platforms for our marketing and sustainability analytics products. The successful candidate will work collaboratively with senior engineers and internal teams to ensure the seamless operation of data pipelines, transforming data into clean, reliable datasets accessible through tools such as Power BI and Tableau. This role requires a commitment to quality and security in data management while contributing to the overall architecture of the data platform.
Responsibilities
- Build and run data pipelines on Azure and Databricks.
- Write transformation logic in PySpark and SQL.
- Schedule, monitor, and troubleshoot data pipelines.
- Ensure multi-tenant data security and governance (Unity Catalog).
- Collaborate with product and engineering teams on new platform features.
- Participate in on-call rotation for production pipeline support.
Requirements
- 5+ years of experience as a Data Engineer working with production pipelines.
- Strong proficiency in PySpark and SQL.
- Experience with Azure and Databricks, particularly Unity Catalog.
- Familiarity with BI tools such as Power BI or Tableau.
- Solid software engineering practices including Git, CI/CD, and testing.
- Ability to work effectively with non-technical and client-facing teams.
- Nice to have experience with Airflow, Kubernetes/AKS, Okta or Entra ID, or exposure to ESG/carbon data.