Overview
We are seeking an experienced Data Engineer to join a dynamic team focused on transforming data and AI capabilities within a leading organization. In this hybrid role, the contractor will design and build scalable data pipelines, solve complex technical challenges, and enhance an enterprise data platform using modern open-source technologies, while working closely with both technical and business stakeholders.
Responsibilities
- Design, build, and maintain data ingestion pipelines and ETL/ELT workflows.
- Develop robust data engineering solutions using Python and SQL.
- Build scalable data pipelines that support multiple business functions.
- Collaborate with technical and business stakeholders to deliver strategic data solutions.
- Solve complex engineering challenges and take ownership from design to delivery.
- Contribute to the evolution of a modern on-premise data platform.
Requirements
- Proven expertise in Python and SQL.
- Experience in building ETL/ELT pipelines and data ingestion frameworks.
- Strong understanding of data architecture and data movement between systems.
- Familiarity with modern data engineering tools and frameworks.
- Extensive experience collaborating with business stakeholders.
- Experience with Apache Spark and Databricks is desirable.
- Background in financial services, commodities, or fast-paced commercial environments is highly advantageous.
- Exposure to AI technologies such as LangChain, agentic AI, or open-source LLMs is beneficial.