Overview
We are seeking Senior Data Engineers with expertise in Databricks for various upcoming consultancy projects. These roles will focus on data engineering using Databricks, Python, and cloud platforms such as Azure, AWS, or GCP. Successful candidates will work remotely and will be part of a team delivering high-quality data solutions to clients, engaging in client-facing roles where applicable.
Responsibilities
- Develop and manage production-grade data pipelines using Databricks.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions.
- Utilize Python, PySpark, and SQL for effective data manipulation and analysis.
- Ensure adherence to best practices in data engineering and architecture.
- Obtain and maintain Databricks certifications to stay updated with platform advancements.
- Engage with clients to gather requirements and provide technical insights as needed.
- Monitor and optimize data workflows and performance across cloud environments.
Requirements
- Proven experience with Databricks and relevant data engineering practices.
- Strong programming skills in Python, PySpark, and SQL.
- Familiarity with cloud platforms: Azure, AWS, or GCP.
- Required Databricks certifications demonstrating proficiency.
- Experience in consultancy or client-facing roles is a plus.
- Ability to work independently and manage multiple projects effectively.
- Immediate availability or soon-to-be available for contract work is preferred.