Lead AI Inference Engineer

Lead AI Inference Engineer

Tether Operations Limited

$ 9.750.000 – $

Overview: Lead AI Inference Engineer to drive local AI systems' delivery. The role requires strong C++ programming skills and experience with Llama.cpp and ggml for deploying machine learning models to edge devices.

Responsibilities

• Work on deploying machine learning models to edge devices using the frameworks: llama.cpp, ggml, onnx
• Collaborate closely with researchers to assist in coding, training and transitioning models from research to production environments
• Integrate AI features into existing products, enriching them with the latest advancements in machine learning
• Managing a cross functional team (pod) made of middleware (JS), foundation (C++), QA and documentation engineers to produce high quality deliverables
• Regularly assessing, both qualitatively and quantitatively, our position in the market with regards to similar prod...