Job Description

This role directly contributes to improving world-class AI systems through high-quality automation, DevOps, and infrastructure scripting expertise.

Key Responsibilities

  • Review and evaluate AI-generated Bash and PowerShell scripts for correctness, clarity, safety, performance, and portability
  • Analyze step-by-step reasoning and troubleshooting workflows behind automation solutions
  • Identify logical errors, edge cases, security risks, and inaccuracies in scripts
  • Write expert-level explanations and model solutions demonstrating best practices
  • Compare, rate, and rank multiple AI responses based on correctness and reasoning quality
  • Create detailed prompts and responses for AI training across automation topics
  • Fact-check technical content and validate accuracy
  • Test AI outputs for reliability, bias, and real-world usability

Required Qualifications

  • Expert-level proficiency in Bash and/or PowerShell scripting
  • 2–3+ years of hands-on scripting and automation experience
  • Strong ability to write, debug, and maintain shell or object-based scripts
  • Experience evaluating scripts for safety, readability, performance, and portability
  • Background in Software Engineering, DevOps, IT Automation, or Infrastructure roles
  • Bachelor’s degree in Computer Science or a closely related technical field
  • Experience using LLMs for coding, troubleshooting, or reviewing scripts
  • Excellent written and spoken English communication skills

Preferred Qualifications

  • Bash tools expertise: awk, sed, grep
  • PowerShell experience with PowerShell Core, DSC, and Azure PowerShell
  • Familiarity with CI/CD pipelines, DevOps workflows, and cloud automation
  • Contributions to open-source CLI, DevOps, or infrastructure projects
  • Previous AI data training or model evaluation experience
  • Minimum C1 English proficiency

Why Join SME Careers

  • Fully remote contract role (U.S.-based)
  • Competitive hourly compensation up to $55/hour
  • Work with leading AI companies and foundation model labs
  • Flexible schedule and high-impact technical work


Apply for this Position

Ready to join ? Click the button below to submit your application.

Submit Application