Sr. SWE for Code Reviewing LLM Data Training (Ruby)

G2i connects subject‑matter experts, students, and professionals with flexible, remote AI training opportunities, including annotation, evaluation, fact‑checking, and content review. We partner with leading AI teams, and all contributions are paid weekly once approved, ensuring consistent and reliable compensation.

About the Role

We're hiring a Code Reviewer with deep Ruby expertise to review evaluations completed by data annotators assessing AI‑generated Ruby code responses. Your role is to ensure that annotators follow strict quality guidelines related to instruction‑following, factual correctness, and code functionality.

Responsibilities

• Review and audit annotator evaluations of AI‑generated Ruby code.
• Assess if the Ruby code follows the prompt instructions, is functionally correct, and secure.
• Validate code snippets using proof‑of‑work methodology.
• Identify inaccuracies in annotator ratings or explanation...