Overview
The Senior Data Engineer will join a high-impact team focused on rebuilding and optimizing data pipelines within a Databricks Lakehouse environment. Collaborating closely with stakeholders, the contractor will ensure the delivery of clean, scalable, and high-quality data for analytics and reporting. This is a hybrid role requiring three days on-site each week, with an initial contract of six months and potential for extension.
Responsibilities
- Design, build, and optimize data pipelines using ELT/ETL best practices.
- Migrate and transform data into a Databricks Lakehouse architecture.
- Ensure data quality, reliability, and scalability for analytics and reporting.
- Collaborate with stakeholders to deliver robust solutions aligned with business needs.
- Support production environments and troubleshoot performance issues.
Requirements
- 7+ years of experience in Data Engineering with strong knowledge of cloud-based data platforms.
- Proven ability to design and optimize pipelines for large-scale data processing.
- Hands-on experience with Databricks, Python, PySpark, SQL, and Azure.
- Strong stakeholder communication and problem-solving skills.
- Experience with Fabric or Copilot is a plus.