Senior LLM Engineer (Prompting & Evaluation)

<b>Job Summary (List Format):</b><br /> <br /> - Design, test, and deploy LLM (Large Language Model) workflows to power Klarion's feedback-intelligence engine.<br /> - Own and improve prompt engineering for state-of-the-art models (OpenAI, Anthropic, etc.) using techniques like few-shot learning, chain-of-thought, and context-tuning.<br /> - Develop and automate evaluation strategies, including precision, recall, cost, and downstream impact, for CI and production environments.<br /> - Build and manage a versioned prompt library with automated rollout/rollback and context-injection patterns.<br /> - Monitor model drift and performance, ensuring robustness against context or model shifts.<br /> - Implement context injection using retrieval-augmented generation (RAG), vector search, and context management patterns (MCP).<br /> - Stay updated on latest LLM research and best practices, translating learnings into code that improves key metrics.<br /> - Collaborate closely with product, platform, and dashboard engineers to rapidly ship and measure new features.<br /> - Utilize strong Python skills to build automated evaluation pipelines, data viewers, and model-selection logic.<br /> - Communicate technical concepts and trade-offs clearly to both engineering and product teams.<br /> - (Bonus) Apply NLP and data science skills for text analytics, pattern detection, and causal analysis.