AI Reliability & Test Automation Engineer

We are building real-time conversational AI systems powered by LLMs, ASR, and TTS. Our products evolve quickly, with new services, workflows, models, and customer-facing features constantly being developed. We are looking for an AI Reliability & Test Automation Engineer to work directly within the LLM AI team to build our automated test capability, helping our systems ship safely and confidently.

This is an embedded engineering role focused on the craft of software testing in complex AI systems. You will design and maintain automated test suites, regression checks, mocks, CI/CD test gates, and release validation processes across LLM-powered workflows, APIs, RAG systems, and conversational journeys.

You will work closely with Machine Learning Engineers, Data Scientists, Backend Engineers, and external testing teams to ensure new features are testable from the start and changes can be evaluated quickly across the wider platform.

What you’ll do

• Bui...