Overview
The Senior Data Engineer will play a critical role in enhancing the data engineering capabilities of a global mining company on a contract basis for six months. Working collaboratively with stakeholders, the contractor will focus on optimizing data processes and implementing robust data solutions. The position requires one day per week on-site in London, ensuring effective communication and collaboration with the team.
Responsibilities
- Develop data pipelines using Azure Data Factory and Databricks.
- Optimize SQL queries for improved performance and efficiency.
- Implement indexing strategies and conduct performance diagnostics.
- Collaborate with stakeholders to gather requirements and provide solutions.
- Utilize Spark and Synapse for large-scale data processing.
- Create impactful visualizations in PowerBI for data analysis.
Requirements
- Proven experience as a Data Engineer with expertise in SQL.
- Strong knowledge of Azure tools including Data Factory, Databricks, and DevOps.
- Familiarity with Spark and Synapse for data processing.
- Demonstrated ability in stakeholder management and collaboration.
- Excellent communication skills and individual contributor mindset.
- Experience with data visualization tools, specifically PowerBI.