Overview
This role offers a unique opportunity for a Lead Data Engineer to take charge of developing advanced data engineering solutions within a prominent global technology organization. The successful contractor will play a pivotal role in the design and implementation of high-quality ETL/ELT pipelines, collaborating with various engineering teams to ensure optimal performance and data integrity.
Responsibilities
- Lead the design, development, and optimisation of data pipelines across diverse SQL-based systems.
- Own the end-to-end ETL/ELT process, from data extraction and transformation through to validation and load.
- Build scalable, efficient solutions to handle large, complex datasets.
- Develop and maintain T-SQL stored procedures, scripts, and automation tools to streamline workflows.
- Collaborate with engineering and testing teams to ensure accuracy, performance, and data quality.
- Champion best practices in data engineering, ensuring robust architecture and documentation.
Requirements
- Proven experience in a lead data engineering role within a large-scale, complex environment.
- Expert-level SQL skills, including performance tuning and stored procedure development.
- Strong background in ETL/ELT pipeline design and integration of multiple SQL data sources.
- Proficient in Python for automation, data manipulation, and testing support.
- Hands-on experience with SSIS.
- Ability to understand and work with complex data models, schemas, and domain structures.
- Excellent problem-solving and communication skills, with a proactive approach to technical ownership.