Job Description



Position Type: Software Developer/Engineer (Mid Level experience)

Location: Philadelphia | Work Mode: Hybrid, minimum 3 days in the office

Interview Schedule: 1 st interview, 1-hour, in-person; 2 nd interview, 1-hour, in-person



Consultant Requirements On-Prem LLM & Vector DB Implementation



Core Experience

  • Hands-on experience deploying open-source LLMs such as Meta Llama 3 and Mistral / Mixtral in on-prem or private environments

  • Strong proficiency in Python for LLM inference, prompt engineering, and integration

  • Experience with CPU-based inference, model quantization, and performance tuning




Vector Databases & RAG


  • Practi...

Apply for this Position

Ready to join HonorVet Technologies? Click the button below to submit your application.

Submit Application