Overview
Join a leading organisation as a Data Engineer, primarily working in a hybrid setup. In this hands-on role, you will be part of a dynamic team focused on building strategic data solutions that are essential for business functions including trading and analytics, while leveraging modern technologies to evolve the enterprise data platform.
Responsibilities
- Design and build data ingestion pipelines and ETL/ELT workflows.
- Develop robust data engineering solutions using Python and SQL.
- Build scalable data pipelines supporting multiple business functions.
- Collaborate with technical and business stakeholders to deliver strategic solutions.
- Solve complex engineering challenges from design through to delivery.
- Contribute to evolving a modern on-premise data platform.
Requirements
- Proven expertise in Python and SQL.
- Experience in building ETL/ELT pipelines and data ingestion frameworks.
- Strong understanding of data architecture and movement between systems.
- Familiarity with modern data engineering tools and frameworks.
- Extensive experience collaborating with business stakeholders.
- Experience with Apache Spark and Databricks is desirable.
- Background in financial services, commodities, or similar fast-paced commercial environments is a plus.
- Exposure to AI technologies like LangChain or open-source LLMs is beneficial.