Overview
We are seeking an experienced Data Engineer proficient in AWS, Python, and Apache Airflow for a remote contract opportunity. The successful candidate will be responsible for building and maintaining data pipelines and cloud-based data solutions, with a focus on data quality and reliability. This role involves collaborating with technical teams to meet programmatic data requirements while adhering to security protocols.
Responsibilities
- Develop and maintain data pipelines using Python and AWS services.
- Build, schedule, and monitor data workflows with Apache Airflow.
- Integrate data from multiple sources and prepare it for downstream use.
- Improve pipeline reliability, performance, and data quality.
- Investigate data processing issues and implement robust solutions.
- Collaborate with technical colleagues and stakeholders to understand data requirements.
- Write clear, maintainable code and document data workflows and processes.
- Apply appropriate security practices when handling data and developing solutions.
Requirements
- Strong commercial experience in data engineering.
- Hands-on experience building and supporting data solutions on AWS.
- Strong Python development skills for data processing and integration.
- Practical experience using Apache Airflow to orchestrate data workflows.
- Experience developing reliable, maintainable data pipelines.
- Methodical approach to troubleshooting and resolving data issues.
- Ability to communicate clearly and work effectively in a remote team.
- Active SC clearance used within the last 12 months.