Overview
The Technical Lead position focuses on building a new greenfield data platform, integrating knowledge graphs and AI elements. The ideal candidate will spearhead the technical development from inception to completion, working closely with Data Analysts and the Product Lead to ensure the successful implementation of the platform. This hybrid role offers flexibility, requiring one day per week on-site while providing opportunities to influence project architecture and technology choices.
Responsibilities
- Design and build the core data layer schema and data migration pipelines, ensuring entity resolution and deduplication.
- Own the technical architecture and technology stack selection for the platform.
- Implement Test Driven Development (TDD) and CI/CD practices from the outset.
- Develop two end-to-end interfaces, one for managing the knowledge graph and another for querying it.
- Create an MCP connector, including API management and authentication mechanisms.
- Collaborate with Data Analysts to refine taxonomy and migration requirements into actionable schema and pipeline changes.
- Manage source control, CI/CD pipelines, and cloud infrastructure associated with platform development.
- Identify and communicate technical risks and trade-offs to the Product Lead as needed.
Requirements
- 6+ years of experience in data engineering and full stack development.
- Strong expertise in SQL and relational database design, focusing on schema design and versioning.
- Proven full stack development skills with a history of delivering client-facing and internal interfaces.
- Sound architectural judgement with the ability to explain and justify build versus buy decisions.
- Experience designing and integrating APIs, covering aspects like authentication and rate limiting.
- Proficiency in cloud services, particularly Azure for data and application hosting.
- Hands-on experience with CI/CD and source control management.
- Familiarity with AI tooling in the software development lifecycle, particularly agentic AI build processes.