Job Description

Role Overview

We are looking for a skilled AI/ML Engineer | Bangalore with 4+ years of experience in designing, developing, and maintaining scalable web applications.


About Us

CodeVyasa is a mid-sized product engineering company that works with top-tier product/solutions companies such as McKinsey, Walmart, RazorPay, Swiggy, and others. We are about 550+ people strong and we cater to Product & Data Engineering use-cases around Agentic AI, RPA, Full-stack and various other GenAI areas.


Key Responsibilities

  • Design, build, and deploy AI/ML solutions with a strong focus on Large Language Models (LLMs) .
  • Develop and maintain applications using LangChain for orchestration, retrieval, and agent workflows.
  • Build and optimize RAG (Retrieval-Augmented Generation) pipelines for enterprise use cases.
  • Integrate LLMs (OpenAI, Anthropic, open-source models) into production systems.
  • Fine-tune, evaluate, and monitor LLM performance for accuracy, latency, and cost.
  • Develop scalable backend services to serve AI models and APIs.
  • Collaborate with product, data, and engineering teams to translate business problems into AI solutions.
  • Implement best practices for model security, prompt management, versioning, and observability.


Must-Have Skills

  • Strong hands-on experience in AI / Machine Learning
  • Practical experience with Large Language Models (LLMs)
  • Hands-on with LangChain (chains, agents, tools, memory, retrievers)
  • Experience building RAG systems using vector databases (FAISS, Pinecone, Weaviate, Chroma, etc.)
  • Strong programming skills in Python
  • Experience with model APIs (OpenAI, Azure OpenAI, HuggingFace, etc.)
  • Understanding of prompt engineering, embeddings, and evaluation techniques


Good-to-Have Skills

  • Experience fine-tuning or serving open-source LLMs (LLaMA, Mistral, Falcon, etc.)
  • Knowledge of ML frameworks (PyTorch, TensorFlow)
  • Experience with MLOps / LLMOps (model deployment, monitoring, CI/CD)
  • Cloud platforms (AWS / Azure / GCP)
  • Experience with agents, tools, function calling, and multi-modal models


Why Join CodeVyasa?

  • Work on innovative, high-impact projects with a team of top-tier professionals.
  • Continuous learning opportunities and professional growth.
  • Flexible work environment with a supportive company culture.
  • Competitive salary and comprehensive benefits package.
  • Free healthcare coverage.
  • Here's a glimpse of what life at CodeVyasa looks likeLife at CodeVyasa.

Apply for this Position

Ready to join ? Click the button below to submit your application.

Submit Application