Overview
The Senior Data Engineer will play a pivotal role in delivering large-scale, data-driven solutions for enterprise clients, leveraging Quantexa's capabilities. Collaborating closely with Architects and Tech Leads, this position focuses on leading the development of data solutions and optimising data pipelines, while supporting integration into broader enterprise data platforms.
Responsibilities
- Lead development of Quantexa-based data solutions.
- Build and optimise data pipelines using Spark, Scala, Databricks, and Python.
- Configure Quantexa components, including Entity Resolution and Scoring.
- Work with Architects and Tech Leads to design scalable production-ready solutions.
- Support integration into wider enterprise data platforms, focusing on cloud, DevOps, and security.
Requirements
- Quantexa Technical Certification is required.
- Strong hands-on delivery experience with Quantexa.
- Experience leading data engineering or integration projects for enterprise clients.
- Proficiency in Scala, Python, and Databricks is essential.
- Experience in Financial Services, AML, Fraud, or KYC is a plus.
- Familiarity with CI/CD tools such as Jenkins, GitHub Actions, or Azure DevOps.
- Exposure to Docker and Kubernetes is beneficial.