Overview
The Senior Data Engineer will play a key role in modernizing the core data platform for a high-growth tech organization. This position offers an opportunity for an experienced data professional to optimize and enhance multi-cloud data architectures, utilizing their expertise in building robust data pipelines and modern tooling. Working within a collaborative environment, the role allows for full technical autonomy to implement critical infrastructure improvements while ensuring best practices are upheld throughout the project.
Responsibilities
- Optimize and streamline data flow across primary public cloud platforms (AWS & GCP/Azure).
- Build, maintain, and refine resilient, scalable ETL/ELT pipelines to support high-throughput data processing.
- Elevate storage architectures, modern data stack tools, and query engines for maximum performance.
- Drive technical delivery using Python, SQL, Spark, dbt, and Terraform.
- Champion robust engineering standards around CI/CD, data quality, and automated monitoring.
- Take direct ownership of project deliverables and provide clear technical direction.
Requirements
- Deep background in production-grade data pipeline architecture and orchestration.
- Hands-on commercial expertise across at least two major cloud platforms (AWS, GCP, or Azure).
- Expertise with Python, PySpark, SQL, and transformation frameworks like dbt.
- Proficiency with Terraform or CloudFormation for repeatable deployment environments.
- Ability to work autonomously and execute project deliverables independently.