Senior Data Engineer

Overview

This role is for a Senior Data Engineer with a strong focus on Quantexa technologies, aimed at enhancing a data engineering team within a prominent international organization. The contractor will be responsible for developing and optimizing enterprise-scale data applications, collaborating with cross-functional teams to translate complex requirements into sustainable technical solutions. The position offers a unique opportunity to take ownership of challenging projects while mentoring junior engineers in a fully remote environment.

Responsibilities

  • Design, develop and maintain scalable data engineering applications using Quantexa technologies.
  • Lead the technical delivery of complex software components, ensuring performance, reliability and maintainability.
  • Work with large, complex datasets to support data processing, integration and analytics.
  • Investigate and resolve challenging technical issues, identifying root causes and implementing long-term solutions.
  • Produce detailed technical documentation covering architecture, development and implementation.
  • Collaborate with engineering, architecture and business teams to translate requirements into effective technical solutions.
  • Mentor junior engineers, conduct code reviews and promote engineering best practices.
  • Identify opportunities to improve development workflows, testing processes and overall platform performance.

Requirements

  • Strong commercial experience with Quantexa and its Decision Intelligence platform.
  • Solid data engineering and software development background.
  • Strong knowledge of Scala and Apache Spark.
  • Experience building and optimising large-scale data processing pipelines.
  • Understanding of data modelling, ETL/ELT processes and distributed computing.
  • Experience with SQL and complex data transformations.
  • Familiarity with CI/CD pipelines, automated testing and version control.
  • Strong troubleshooting, debugging and performance optimisation skills.