Overview
This role for a Senior Data Scientist centers on an enterprise project focused on building out AI capabilities on the Databricks platform. The contractor will collaborate with a technical delivery team to design, build, and productionize advanced AI and GenAI solutions, ensuring effective integration and deployment within the organization.
Responsibilities
- Build and enhance AI platform capabilities using Databricks.
- Develop Medallion Architecture pipelines (Bronze, Silver, Gold Delta tables).
- Build AI agents, vector search solutions, and unstructured data processing pipelines.
- Support RAG, LLMOps, prompt engineering, and AI solution productionization.
- Implement data governance capabilities including Unity Catalog.
- Develop lightweight applications and automation workflows to support AI solutions.
- Collaborate using Git, CI/CD, and modern engineering practices.
Requirements
- 4+ years’ Data Science experience.
- 2+ years’ consulting or client delivery experience.
- Proven experience delivering AI/ML solutions into production.
- Strong Python and Databricks experience.
- Hands-on experience with PySpark, Delta Lake, Unity Catalog, and MLflow.
- Experience with GenAI technologies including LLMs, RAG, AI agents, and prompt management.
- Familiarity with Git workflows and CI/CD pipelines.
- Experience with Databricks AI capabilities such as AI Gateway, AI Search, Databricks Apps, and Asset Bundles is highly desirable.