Overview
The Data Platform Engineer will be responsible for building and operating a comprehensive data platform that supports various engineering teams for a large, regulated organisation. This role emphasizes strong collaboration with architects and data engineers to translate design concepts into a functioning platform, ensuring reliability, observability, and security through automated processes and CI/CD practices.
Responsibilities
- Build and operate the Snowflake platform on AWS, utilizing OpenShift.
- Own and manage CI/CD for data, including deployment pipelines and tooling.
- Implement infrastructure as code to ensure a reliable and secure platform.
- Collaborate with architects and data engineers to turn design into a working platform.
- Automate repetitive tasks to enhance efficiency in platform management.
- Utilize AI-assisted development tools in daily workflows.
Requirements
- Significant experience with Snowflake, beyond basic querying.
- Proficiency in AWS and container technologies, preferably OpenShift or Kubernetes.
- Demonstrated experience in CI/CD specific to data workloads.
- Strong infrastructure-as-code skills with a focus on automation.
- Familiarity with AI-assisted development tools, such as GitHub Copilot.
- Experience in a regulated or financial services environment is a plus.