Software Engineer - AI Performance

Software Engineer : AI Performance

Apply for the role at DevRev

At DevRev we are building the future of work with Computer – your AI teammate. Computer is built on the belief that the future of work should be about genuine human connection and collaboration – not piling on more apps. It amplifies your strengths, takes repetition and frustration out of your day, and gives you more time and energy to do your best work.

Computer is the only platform capable of Complete data unification and Powerful search, reasoning, and action . It integrates all data sources (like Google Workspace, Jira, Notion) into one AI‑ready source of truth – Computer Memory. It offers employees insights, proactive suggestions, and agentic actions, allowing teams to update workflows and coordinate across systems.

We call this Team Intelligence – why DevRev exists. Trusted by global companies and backed by Khosla Ventures and Mayfield, we have over 650 people across eight global offices.

About the Role

DevRev is ushering in the SaaS 2.0 era – where enterprise software is not just connected, but intelligent. The mission is to reintroduce Computer to the enterprise as an agent that thinks, reasons, and acts on behalf of users.

We’re looking for experienced software engineers who have built and scaled applications, APIs, and cloud architectures – ready to level up into AI performance and benchmarking. Prior AI experience is not required; strong engineering fundamentals, curiosity, and a drive to learn are enough.

What You’ll Do

• Participate in a structured training track to develop expertise in AI benchmarking, profiling, and performance tuning.
• Build and scale benchmarking infrastructure for evaluating AI systems in enterprise settings.
• Design agent evaluation pipelines that measure reasoning, accuracy, alignment, and user outcomes.
• Collaborate with AI and infra teams to instrument model‑serving systems (vLLM, Triton, Ray, or Kubernetes‑based deployments).
• Develop data and telemetry pipelines that capture model performance, latency, and quality.
• Contribute to DevRev’s open benchmarking frameworks, defining how intelligent SaaS software is measured globally.
• Work with cross‑functional teams to ensure benchmarks reflect real‑world customer value and system impact.

What You’ll Bring

• 3–10+ years of experience as a Software Engineer in backend, systems, or infrastructure roles.
• Strong foundation in Python or similar backend languages – Go, Java, C#, or Node.js.
• Hands‑on experience building APIs and cloud‑native architectures (AWS, GCP, or Azure; Kubernetes a plus).
• Understanding of metrics, profiling, or observability tools (Grafana, Prometheus, ELK, or similar).
• Curiosity and commitment to learn AI benchmarking, LLM evaluation, and performance frameworks.
• Strong analytical and product intuition – you care about what the benchmark represents, not just what it measures.
• Bonus: exposure to vector search, model tuning (LoRA, DPO), or open‑source contributions.

Why This Role Matters

Agents are not APIs – they reason, adapt, and learn. The benchmarks of the past aren’t enough for the software of the future. This role lets you design the KPIs of the AI‑native enterprise and bring rigor to systems that reason and structure to software that thinks.

Culture

The foundation of DevRev is its culture – commitment to hungry, humble, honest, and people‑with‑heart individuals. Our vision is to help build Earth’s most customer‑centric companies and enable engineers to embrace their customers through design, data engineering, and machine intelligence.