Job Description
Job Title: AI Agent Evaluation Engineer
Experience Level: 5–8 Years
Work Distribution: ~70% Automation Testing / ~30% Manual Testing
Primary Focus Areas: Responsible AI, Safety Evaluations, and Google ADK
Role Summary:
We are seeking a seasoned QA professional to lead evaluation and testing efforts for AI and LLM-based systems. The ideal candidate will have deep experience in validating conversational agents, conducting safety and adversarial assessments, and working with Google’s Agent Development Kit (ADK) and Vertex AI ecosystem.
Mandatory Requirements:
AI / LLM Testing Expertise
- At least 2 years dedicated experience testing or evaluating AI systems, conversational agents, or large language models (LLMs).
- Proven track record of designing, executing, and reviewing AI evaluation frameworks and test suites, including both automated and exploratory evaluations.
Safety & Red Teaming
- Hands-on experience with safety evaluations is mandatory.
- Demo...
Experience Level: 5–8 Years
Work Distribution: ~70% Automation Testing / ~30% Manual Testing
Primary Focus Areas: Responsible AI, Safety Evaluations, and Google ADK
Role Summary:
We are seeking a seasoned QA professional to lead evaluation and testing efforts for AI and LLM-based systems. The ideal candidate will have deep experience in validating conversational agents, conducting safety and adversarial assessments, and working with Google’s Agent Development Kit (ADK) and Vertex AI ecosystem.
Mandatory Requirements:
AI / LLM Testing Expertise
- At least 2 years dedicated experience testing or evaluating AI systems, conversational agents, or large language models (LLMs).
- Proven track record of designing, executing, and reviewing AI evaluation frameworks and test suites, including both automated and exploratory evaluations.
Safety & Red Teaming
- Hands-on experience with safety evaluations is mandatory.
- Demo...
Apply for this Position
Ready to join CloudFulcrum? Click the button below to submit your application.
Submit Application