Overview
As a Data Platform Engineer, you will play a crucial role in establishing and maintaining the data platform for a large regulated organization modernizing its data estate. Collaborating closely with architects and data engineers, you will ensure the platform is reliable and secure while supporting the deployment of data workloads. This position combines technical expertise in Snowflake, AWS, and container orchestration with the ability to automate processes, making it central to the organization's data strategy.
Responsibilities
- Build and operate the Snowflake platform on AWS using OpenShift.
- Own CI/CD processes for data deployment pipelines and environments.
- Implement infrastructure as code to maintain a reliable and secure platform.
- Collaborate with architects and data engineers to execute design plans into functioning platforms.
- Automate repetitive tasks and enhance operational efficiency.
- Utilize AI-assisted development tools like GitHub Copilot to improve workflow.
- Ensure observability and security measures are in place for the platform.
Requirements
- Strong experience with the Snowflake platform beyond querying.
- Solid knowledge of AWS and container management, preferably with OpenShift or Kubernetes.
- Demonstrated experience with CI/CD processes specifically for data workloads.
- Proficient in infrastructure as code practices and automation tools.
- Familiarity with AI-assisted development tools in everyday workflows.
- Experience in a regulated or financial services environment is a plus.