Overview
The Data Platform Engineer will be responsible for building and operating a data platform for a large, regulated organization undergoing modernization of its data estate. This role will involve collaboration with architects and data engineers to ensure the platform is reliable, secure, and efficient, utilizing infrastructure as code principles. The position provides an opportunity to leverage AI-assisted development tools while contributing to an evolving technical landscape.
Responsibilities
- Build and operate the Snowflake platform on AWS running on OpenShift.
- Own CI/CD for data, including deployment pipelines and environments.
- Develop tooling to support safe deployments for data engineers.
- Ensure the platform remains reliable, observable, and secure.
- Collaborate with architects and data engineers to implement design into a functional platform.
- Automate processes to enhance efficiency and reduce manual interventions.
Requirements
- Strong experience with the Snowflake platform, not limited to querying.
- Solid understanding of AWS and container technologies, preferably OpenShift or Kubernetes.
- Demonstrated CI/CD experience focusing on data workloads.
- Knowledge of infrastructure as code practices and automation.
- Familiarity with AI-assisted development tools like GitHub Copilot.
- Experience in regulated environments, particularly in financial services, is a plus.