Overview
We are seeking experienced Senior Data Engineers with strong expertise in Databricks for an initial six-month contract. The role is fully remote and will involve working with a consultancy on various client projects, focusing on delivering production-grade data engineering solutions. Ideal candidates will be well-versed in cloud platforms such as Azure, AWS, or GCP, and have a proven track record in a consultancy or client-facing environment.
Responsibilities
- Develop data engineering solutions using Databricks for client projects.
- Collaborate with multidisciplinary teams to understand and document data requirements.
- Design, build, and optimize scalable data pipelines and workflows using Python, PySpark, and SQL.
- Implement data processing strategies to ensure high-quality data management and analysis.
- Ensure adherence to best practices in data engineering and cloud architecture.
- Maintain Databricks environments and implement necessary updates or changes as required.
- Provide technical support and guidance to clients regarding data engineering processes.
Requirements
- Significant commercial experience with Databricks.
- Proficiency in Python, PySpark, and SQL for data processing.
- Experience with cloud platforms such as Azure, AWS, or GCP.
- Demonstrated production-grade data engineering experience.
- Relevant Databricks certifications are essential.
- Consultancy or client-facing experience is a plus.
- Availability to start in mid-November or sooner.