Overview
This role is for a Senior Data Engineer with a strong focus on Quantexa technologies, aimed at enhancing a data engineering team within a prominent international organization. The contractor will be responsible for developing and optimizing enterprise-scale data applications, collaborating with cross-functional teams to translate complex requirements into sustainable technical solutions. The position offers a unique opportunity to take ownership of challenging projects while mentoring junior engineers in a fully remote environment.
Responsibilities
- Design, develop and maintain scalable data engineering applications using Quantexa technologies.
- Lead the technical delivery of complex software components, ensuring performance, reliability and maintainability.
- Work with large, complex datasets to support data processing, integration and analytics.
- Investigate and resolve challenging technical issues, identifying root causes and implementing long-term solutions.
- Produce detailed technical documentation covering architecture, development and implementation.
- Collaborate with engineering, architecture and business teams to translate requirements into effective technical solutions.
- Mentor junior engineers, conduct code reviews and promote engineering best practices.
- Identify opportunities to improve development workflows, testing processes and overall platform performance.
Requirements
- Strong commercial experience with Quantexa and its Decision Intelligence platform.
- Solid data engineering and software development background.
- Strong knowledge of Scala and Apache Spark.
- Experience building and optimising large-scale data processing pipelines.
- Understanding of data modelling, ETL/ELT processes and distributed computing.
- Experience with SQL and complex data transformations.
- Familiarity with CI/CD pipelines, automated testing and version control.
- Strong troubleshooting, debugging and performance optimisation skills.