Overview
The Principal Data Engineer will play a crucial role in a strategic data transformation project, focusing on modernizing a business-critical operational platform through the development of a scalable, cloud-native solution. The contractor will collaborate with a cross-functional team, including Solution Architects and Data Specialists, to take ownership of the platform's technical design and engineering, ensuring high-volume invoicing and operational workflows are automated effectively. This position offers the opportunity to work remotely, with occasional travel to Leeds.
Responsibilities
- Design and build a cloud-native AWS data platform.
- Lead technical delivery of the minimum viable product (MVP).
- Build scalable serverless data pipelines and APIs.
- Design secure, resilient event-driven architectures.
- Collaborate with Architecture, Platform, Security, and Data teams.
- Implement Infrastructure as Code (IaC), Continuous Integration/Continuous Deployment (CI/CD), and monitoring solutions.
Requirements
- Proven experience with enterprise AWS data platforms.
- Strong proficiency in Python programming.
- Experience with serverless AWS architectures.
- Knowledge of event-driven architecture principles.
- Proficient in Terraform or CloudFormation.
- Familiarity with CI/CD practices and enterprise security in AWS.
- Experience with AWS services including Lambda, Step Functions, DynamoDB, and others relevant to data engineering.