Overview
We are seeking a highly skilled Senior Backend Engineer/Data Scientist for a short-term, fully remote contract. The successful candidate will collaborate independently with a Life Sciences client to design and implement a bespoke AI-powered tool aimed at automating the URL redirect mapping process during a large-scale web migration project. This role involves developing a functional data pipeline under a rapid timeline.
Responsibilities
- Design and implement an AI-powered tool for URL redirect mapping.
- Develop and deliver a functional data ingestion pipeline connecting to a WordPress VIP API.
- Utilize LLMs for semantic analysis and matching within the content of source pages.
- Analyze and compare output against provided destination site structures from a spreadsheet.
- Output structured data mappings with confidence scores for manual review.
- Ensure timely delivery of the solution within the designated project timeline.
- Collaborate with the client to refine project requirements and tool functionality.
Requirements
- Proven experience in developing data ingestion pipelines with third-party REST APIs.
- Hands-on experience with LLMs for semantic analysis, classification, and structured data output.
- Proficiency in programming languages such as Python, TypeScript, or .NET.
- Familiarity with OpenAI Batch API and WordPress API integrations.
- Experience with SAAS databases, like Supabase, for data persistence.
- Understanding of generative AI and natural language processing concepts and libraries.