Job Description
Join as a QA Lead focusing on AI model testing within a contract role based in Montreal, QC. Showcase your expertise in LLM and RAG pipeline validation.
We are seeking an experienced QA Lead passionate about AI testing for a contractual position in Montreal. This role demands hands-on skills in prompt engineering, diagnosing LLM failure modes, and validating data quality in AI systems. Your responsibilities will include developing comprehensive test strategies while collaborating with ML engineers to enhance product quality at every stage of development.
Key Responsibilities:
• Lead comprehensive test strategies for AI/ML systems
• Review and maintain LangChain and LangGraph test harnesses
• Ensure RAG pipeline integrity and data retrieval accuracy
• Track and report on generative AI quality metrics
• Collaborate with product and development teams effectively
Requirements:
• Proven QA experience with AI/ML systems
• Strong grasp of prompt creation and LLM ...
We are seeking an experienced QA Lead passionate about AI testing for a contractual position in Montreal. This role demands hands-on skills in prompt engineering, diagnosing LLM failure modes, and validating data quality in AI systems. Your responsibilities will include developing comprehensive test strategies while collaborating with ML engineers to enhance product quality at every stage of development.
Key Responsibilities:
• Lead comprehensive test strategies for AI/ML systems
• Review and maintain LangChain and LangGraph test harnesses
• Ensure RAG pipeline integrity and data retrieval accuracy
• Track and report on generative AI quality metrics
• Collaborate with product and development teams effectively
Requirements:
• Proven QA experience with AI/ML systems
• Strong grasp of prompt creation and LLM ...
Apply for this Position
Ready to join Jay Analytix? Click the button below to submit your application.
Submit Application