Overview
We are seeking a Senior Data Engineer with fluency in French to lead the development of a new enterprise data platform for a Data & AI consultancy. This fully remote role involves hands-on engineering and solution design, focusing on building scalable data pipelines and modernizing data models within a Databricks environment. The contractor will collaborate with technical stakeholders and deliver robust solutions that meet client requirements.
Responsibilities
- Design and develop end-to-end data pipelines using Azure Databricks.
- Build and optimise Bronze, Silver, and Gold data layers.
- Ingest data from SQL databases, REST APIs, SharePoint, and file-based sources.
- Modernise existing Data Vault models into dimensional data models using Kimball methodology.
- Implement incremental data loading, schema evolution, and change data capture (CDC).
- Develop transformation, orchestration, and data quality processes.
- Configure Unity Catalog governance with access controls and GDPR requirements.
- Implement CI/CD pipelines and automate Databricks deployment.
Requirements
- 5+ years of professional Data Engineering experience.
- 3+ years working within consultancy or client-facing environments.
- Hands-on experience with at least 2–3 Databricks projects.
- Strong proficiency in Python, PySpark, SQL, and Apache Spark.
- Experience with Delta Lake, Unity Catalog, and Medallion Architecture.
- Knowledge of Databricks Auto Loader, Lakeflow Jobs, and Spark Declarative Pipelines.
- Strong dimensional data modelling experience, including Kimball and SCD2.
- Fluent French communication skills.