AI Automation Test Engineer

AI Automation Test Engineer (Python & GenAI/LLM)

6-12yrs

Hyderabad

Job Summary:

Test generative AI solutions on AWS, validating LLMs, RAG, prompts, and agentic workflows with n8n and Python libraries like deepchecks, Ragas and LangChain.

Key Requirements (8 Points):

• Test LLM outputs on AWS Bedrock using boto3.
• Validate fine-tuned LLMs on AWS SageMaker with deepchecks.
• Verify langchain prompts in AWS environments.
• Test RAG pipelines with AWS OpenSearch and langchain.
• Validate AI agents (crewai/autogen) on AWS Lambda/equivalent
• Test n8n agentic workflows (e.g., n8n.io/workflows/6270).
• Ensure deployment stability on Amazon ECS/EKS with Docker.
• Monitor performance with Amazon CloudWatch and wandb.

Must-Have Skills:

• 2 years testing GenAI/LLMs using Python
• 4+ years’ experience in QA Automatio...