Overview
As a Senior Data Engineer, you will work closely with the Head of Data and Lead Data Scientist/Engineer to design and build robust data pipelines that connect varied inputs to defined outcomes. This contract position requires hands-on development and the ability to navigate incomplete requirements while ensuring adherence to high production standards. Your expertise will help streamline project workflows and enhance data reliability across the organization.
Responsibilities
- Transform client data from various sources into reliable Python pipelines.
- Specify and implement schemas and storage layouts to facilitate extensions of the work.
- Orchestrate jobs using Python, preferably with Dagster, but alternatives are acceptable.
- Collaborate with the data team to shape approaches while maintaining design coherence and execution speed.
- Utilize AI coding tools effectively throughout the development process and provide architectural oversight.
Requirements
- Strong production-level Python programming skills.
- Proven experience in designing data models and schemas.
- Ability to operate with incomplete requirements and generate necessary solutions.
- Demonstrated capability in building production data pipelines from complex source data.
- Experience with AI-assisted development tools like Cursor or Copilot in practical settings.
- Minimum of 4 years working with data or machine learning systems in a production environment.
- Prior experience in startup or small product teams is a plus.
- Familiarity with tools such as Dagster, Airflow, or Prefect is advantageous.