AI Benchmarking Spec. - Spanish, SFIX

Overview

The Seller AI team within International Seller Services focuses on helping sellers with Gen-AI/LLM powered tools and agentic solutions to accelerate business growth on Amazon. Our primary focus lies in handling annotations for training, measuring, and improving Artificial Intelligence (AI) and Large Language Models (LLMs) to deliver a superior seller experience worldwide. The AI Benchmarking Associate supports the evaluation of AI systems by designing and executing benchmarking and audit activities to assess model quality, compliance, robustness, and fairness. The role combines AI auditing, quality assurance, and traditional audit‑style documentation and stakeholder communication to shape the future of selling on Amazon for sellers worldwide.

Responsibilities

• Assist in planning and executing benchmarking exercises for AI models, including defining test plans, metrics, and acceptance criteria across accuracy, robustness, bias, and reliab...