Overview
As a Senior Data Engineer, you will play a critical role in modernizing a cloud-based data platform for a growing business. This position involves collaborating with stakeholders to deliver scalable data solutions and mentoring junior engineers while enhancing the reliability and performance of data infrastructure. You will primarily focus on designing, building, and optimizing ETL/ELT pipelines and deploying production ML systems.
Responsibilities
- Modernize data lake and data warehouse architecture.
- Design, build, and optimize ETL/ELT pipelines.
- Deploy and support production ML systems, including forecasting models.
- Enhance an AWS-native data platform using services like S3, Redshift, and SageMaker.
- Write high-performance SQL and production-quality Python code.
- Improve platform reliability, monitoring, and CI/CD processes.
- Collaborate with stakeholders to deliver scalable data solutions.
- Mentor junior engineers through code reviews and best practices.
Requirements
- Strong experience in building production-grade data pipelines.
- Advanced skills in SQL and Python.
- Experience in deploying and supporting ML models in production.
- AWS cloud experience with a solid understanding of DevOps/platform engineering.