Job Description

Job Summary

  • Test generative AI solutions on AWS validating LLMs RAG prompts and agentic workflows with n8n and Python libraries like deepchecks and LangChain

Key Requirements 8 Points

  • Test LLM outputs on AWS Bedrock using boto3
  • Validate finetuned LLMs on AWS SageMaker with deepchecks
  • Verify langchain prompts in AWS environments
  • Test RAG pipelines with AWS OpenSearch and langchain
  • Validate AI agents crewaiautogen on AWS Lambda
  • Test n8n agentic workflows eg n8nioworkflows6270
  • Ensure deployment stability on Amazon ECSEKS with Docker
  • Monitor performance with Amazon CloudWatch and wandb

Must Have Skills

  •  5 years of QA automation 2 years testing GenAILLMs using Python
  •  Expertise in AWS Bedrock SageMaker Lambda boto3
  •  Proficiency in deepchecks langchain crewai autogen wandb
  •  Experience testing n8n workflows RAG prompts

Preferred Skills

  •  AWS certification Machine LearningSolutions Architect
  •  Familiarity with llamaindex n8n templates

Skills Required
Jenkins, User Acceptance Testing

Apply for this Position

Ready to join ? Click the button below to submit your application.

Submit Application