Job Description

About the job


About Senzcraft:

Founded by IIM Bangalore and IEST Shibpur Alumni, Senzcraft is a hyper-automation company. Senzcraft vision is to Radically Simplify Today‘s Work. And Design Business Process For The Future. Using intelligent process automation technologies.

We have a suite of SaaS products and services, partnering with automation product companies.

Please visit our website - for more details

Our AI Operations SaaS platform –

Senzcraft on linkedin ->

Senzcraft is awarded by Analytics India Magazine in it’s report “State of AI in India” as a “Niche AI startup” ‘Agentic AI Service Provider‘ | Senzcraft is also recognized by NY based SSON as a top hyper-automation solutions provider.


About the Role (AI Test Engineer – Data & AI Products) :

We are looking for a Senior QA / Test Engineer – Data & AI to ensure the quality, reliability, and trustworthiness of data-driven, ML, and LLM-powered products. This role combines hands-on testing with quality leadership, focusing on data pipelines, AI/ML models, APIs, and GenAI/LLM systems in an enterprise and regulated environment.


You will work closely with Data Scientists, Data Engineers, Product Managers, and R&D teams to define test strategies, automate validation, and embed quality gates across the AI product lifecycle.


Key Responsibilities:

  • Define test strategies for Data, Analytics, ML, and LLM-based systems
  • Design and execute test cases across data ingestion, transformation, storage, and consumption layers
  • Validate data quality (accuracy, completeness, consistency, timeliness) across pipelines
  • Perform ML model validation including training, inference, retraining workflows, and output correctness
  • Define and implement LLM evaluation strategies:
  • Golden datasets
  • Prompt/response validation
  • Hallucination, relevance, consistency, latency checks
  • Guardrails and safety testing
  • Design, automate, and execute API test suites (functional, contract, performance, resilience)
  • Build Python/SQL-based automation frameworks for data, API, and AI testing
  • Monitor and validate model performance, drift, and data drift in production-like environments
  • Integrate testing into CI/CD pipelines (Azure DevOps), enforcing quality gates and dashboards
  • Create and maintain PDLM/QMS deliverables:
  • Verification & Validation plans
  • Test protocols and reports
  • Risk-based coverage
  • Traceability matrices mapped to requirements and use cases
  • Log, track, and manage defects related to data pipelines, APIs, and AI outputs
  • Collaborate with Product, Clinical/R&D, and Engineering teams to refine requirements and acceptance criteria
  • Mentor junior testers and promote best practices in Data & AI Quality Engineering


Required Skills & Experience:

Education

  • Bachelor’s degree in Computer Science, Data Engineering, AI, or related field

Experience

  • 5–8+ years of experience in QA / Test Engineering
  • Strong experience testing Data platforms, Analytics systems, ML models, and AI services
  • Hands-on experience with API automation, performance testing, and CI/CD
  • Experience working in Agile/Scrum environments
  • Exposure to regulated or enterprise-grade product lifecycles is a strong plus


Apply for this Position

Ready to join ? Click the button below to submit your application.

Submit Application