Overview
The Senior Data & Reporting Engineer will play a critical role in supporting a major public sector cloud-based data programme focused on occupancy analytics and smart building technologies. They will work within a multi-disciplinary Agile team to design, build, and optimize data pipelines and reporting solutions that convert complex operational data into actionable business insights. The role requires active SC clearance and involves collaborating with cloud and platform engineers to enhance a sophisticated AWS-hosted platform.
Responsibilities
- Design, build and maintain scalable data models, schemas and reporting structures.
- Develop, optimise and support ETL/ELT pipelines for occupancy and operational datasets.
- Integrate data from multiple sources including WiFi, IoT sensors and third-party systems.
- Improve data quality, consistency and reliability across the platform.
- Create and maintain curated datasets for reporting, analytics and business intelligence.
- Collaborate with cloud and platform engineers to optimise data ingestion and processing.
- Investigate and resolve complex data quality, transformation and reporting issues.
- Drive continuous improvement across data engineering and reporting capabilities.
Requirements
- Active SC Clearance.
- Significant experience in data engineering and data pipeline development.
- Strong expertise in ETL/ELT design, development and optimisation.
- Advanced SQL development and query optimisation skills.
- Strong Python development experience for data processing and automation.
- Experience integrating multiple systems and data sources.
- Strong understanding of data quality, validation and reconciliation techniques.
- Experience with data governance, metadata management and data lineage.