Overview
The Data Platform Architect will play a crucial role in delivering key public sector projects over a three-month engagement, collaborating closely with senior stakeholders to ensure the effective and strategic use of data. This role requires a strong background in Government Digital Service (GDS) projects and expertise in data governance, AWS, and Databricks, enabling the architect to lead integration and transformation efforts across various data sources.
Responsibilities
- Support the design and implementation of data platforms for public sector projects.
- Collaborate with senior stakeholders to gather requirements and align data strategies.
- Integrate source systems across databases, files, and APIs using AWS and Databricks.
- Develop ingestion patterns and manage data lake/lakehouse storage on Amazon S3.
- Implement transformation, orchestration, and serving patterns within Databricks.
- Establish governance, security, and operational support controls for data management.
- Provide guidance on data usage for reporting, analytics, applications, and APIs.
Requirements
- Proven experience in GDS-based assignments and public sector projects.
- Strong knowledge of data governance principles.
- Experience with AWS services, particularly S3, Databricks, and data integration.
- Familiarity with data ingestion patterns and storage solutions.
- Ability to design transformation and orchestration patterns using Databricks.
- Expertise in serving and consumption patterns for analytics and reporting.
- Understanding of governance, security, observability, and resilience in data operations.