Job Description

Responsibilities

  • Lead the integration of cutting-edge language technologies into real-world applications
  • Collaborate cross-functionally with software engineers, DevOps, and product teams
  • Build and deploy rapid prototypes and MVPs
  • Design and optimize prompts for various LLM use cases
  • Implement evaluation metrics for models, including perplexity and user satisfaction
  • Monitor production systems for drift detection and performance degradation
  • Automate metric tracking via MLflow or custom dashboards
  • Conduct A/B testing for evaluating GenAI features in production environments

Technologies

  • AI
  • API
  • Azure
  • DevOps
  • FastAPI
  • Flask
  • Git
  • GitHub
  • LLM
  • Python
  • SQL
  • numpy
  • pandas
  • Cloud
  • Support
  • Marketing

Qualifications

  • Proficiency in Python Pr...

Apply for this Position

Ready to join Certain Advantage? Click the button below to submit your application.

Submit Application