Multilingual Audio Personalization Evaluator

About the Role

We are looking for experienced annotators with deep cultural, linguistic, and audio catalog expertise to help improve a major music platform's personalized experiences across multiple languages and regions. 

In this role, you will create high-quality ground truth and evaluate the quality of both training data and model-generated output for various features. Your insights will help shape how listeners around the world discover and enjoy music, podcasts, and audiobooks. 

What You'll Do

• Evaluate agentic and personalized experiences and a

ssess search relevance & recommendations 

• Perform complex qualitative assessments to support emerging agentic and conversational listening experiences. 

• Judge how well recommendations, responses, and UI elements reflect local culture, language norms, and audio habits. 

• Review playlist and recommendation quality, including how well results matc...