Cricket Rater

Job Title: Cricket Rater / Sports Content Evaluator (Live Match Project)

Overview

We are looking for passionate cricket enthusiasts to support a live AI evaluation project. The role requires raters to simulate the experience of a dedicated cricket fan by interacting with AI systems during live matches and evaluating AI-generated responses for accuracy, helpfulness, and factual correctness.

Key Responsibilities

• Actively watch and track live cricket matches and engage with AI platforms in real time.
• Identify, generate, and evaluate cricket-related queries (pre-match, in-game, and post-match), including those related to leagues, teams, players, and match events.
• Perform Side-by-Side (SxS) evaluations across multiple AI platforms (including ChatGPT) to compare responses.
• Capture and submit screenshots of AI outputs and findings as part of the evaluation process.
• Assess AI responses for helpfulnes...