Job Description
AI Automation Test Engineer (Python & Gen AI/LLM)
6-12yrs
Hyderabad
Job Summary :
Test generative AI solutions on AWS, validating LLMs, RAG, prompts, and agentic workflows with n8n and Python libraries like deepchecks, Ragas and Lang Chain.
Key Requirements (8 Points) :
Test LLM outputs on AWS Bedrock using boto3.
Validate fine-tuned LLMs on AWS Sage Maker with deepchecks.
Verify langchain prompts in AWS environments.
Test RAG pipelines with AWS Open Search and langchain.
Validate AI agents (crewai/autogen) on AWS Lambda/equivalent
Test n8n agentic workflows (e.g., n8n.io/workflows/6270 ).
Ensure deployment stability on Amazon ECS/EKS with Docker.
Monitor performance with Amazon Cloud Watch and wandb.
Must-Have Skills :
2 years testing Gen AI/LLMs using Python
4+ years’ experience in QA Automation
Expertise in AWS Bedrock, Sage Maker, Lambda, boto3.
Proficiency in deepchecks, langchain, crewai, autogen, wandb.
Experience testing ...
6-12yrs
Hyderabad
Job Summary :
Test generative AI solutions on AWS, validating LLMs, RAG, prompts, and agentic workflows with n8n and Python libraries like deepchecks, Ragas and Lang Chain.
Key Requirements (8 Points) :
Test LLM outputs on AWS Bedrock using boto3.
Validate fine-tuned LLMs on AWS Sage Maker with deepchecks.
Verify langchain prompts in AWS environments.
Test RAG pipelines with AWS Open Search and langchain.
Validate AI agents (crewai/autogen) on AWS Lambda/equivalent
Test n8n agentic workflows (e.g., n8n.io/workflows/6270 ).
Ensure deployment stability on Amazon ECS/EKS with Docker.
Monitor performance with Amazon Cloud Watch and wandb.
Must-Have Skills :
2 years testing Gen AI/LLMs using Python
4+ years’ experience in QA Automation
Expertise in AWS Bedrock, Sage Maker, Lambda, boto3.
Proficiency in deepchecks, langchain, crewai, autogen, wandb.
Experience testing ...
Apply for this Position
Ready to join Tredence Inc.? Click the button below to submit your application.
Submit Application