Job Description

Role: Sr. AI QE (Quality Engineer) # of Position: 1 Location: Bangalore/Pune/ Vadodra/ Chennai/ Hyderabad Shift Hours: 3:30PM to 12:30AM IST Summary The Senior AI Quality Engineer is responsible for ensuring reliability, accuracy, safety, and performance of the Agentic AI platform. This role goes beyond traditional QA, focusing on LLM behavior validation, agent orchestration testing, hallucination detection, prompt regression, and production hardening of AI systems. Key Responsibilities Design and execute AI-specific test strategies for agentic workflows (agent interactions, tool calling, RAG pipelines). Validate LLM outputs for accuracy, relevance, bias, safety, and policy compliance. Create automated test frameworks for prompt regression, agent / model routing, and decision consistency. Perform Integration testing with internal and external systems Test AI failure modes: hallucinations, partial responses, tool failures, latency spikes, and token exhaustion. Perform load, stress, and ...

Apply for this Position

Ready to join Awign Expert? Click the button below to submit your application.

Submit Application