Senior Engineer ML

Position Title: Sr Engineer AIOps

Job Description:

Roles & responsibilities:

• Architect and maintain scalable ML pipelines on Databricks, leveraging Unity Catalog for data governance and MLflow for model lifecycle management.
• Design and automate CI/CD workflows for ML models using tools such as GitHub Actions, Databricks Workflows, and Terraform.
• Deploy and monitor model serving architectures across multi-cloud environments (GCP, Azure), including inference via external APIs like OpenAI.
• Integrate frameworks like LangChain to enable agent-based ML systems that interact with external APIs within Databricks notebooks.
• Ensure secure API access, secrets management, and compliance across cloud boundaries, working closely with security and governance teams.

Experience:

• Were seeking a seasoned MLOps Engineer with 57 years of experience to lead the design and scaling of production-grade machine learning systems on Databricks. This role focuses on automating ML pipelines, enabling cross-cloud inference, and ensuring secure, compliant, and observable deployments. Youll collaborate with data scientists, platform engineers, and compliance teams to build robust infrastructure using tools like Unity Catalog, MLflow, LangChain, and more.

Required Qualifications:

• Bachelors or masters degree in computer science, Engineering, or a related field.
• 57 years of experience in MLOps or ML engineering, with hands-on expertise in Databricks environments.
• Strong proficiency in Python, including integration of external APIs and libraries (e.g., LangChain, OpenAI).
• Proven experience with CI/CD pipelines, container orchestration (Docker/Kubernetes), and infrastructure-as-code tools like Terraform.
• Solid understanding of model monitoring, performance profiling, and observability tools across GPU/CPU workloads.

Preferred Qualifications

• Experience deploying ML applications for optimization or pricing algorithms.
• Familiarity with AI safety, compliance, and governance frameworks.
• Contributions to open-source projects related to Databricks, MLflow, or MLOps.
• Experience mentoring junior engineers and establishing best practices for ML infrastructure.

Competencies:

• Compassionate and kind, showing courtesy, dignity, and respect. They show sincere interest and empathy for all others.
• Show integrity in what is done and how it is done - without sacrificing personal/business ethics.
• Embrace an inclusion-focused mindset, seeking input from others on their work and encouraging the open expression of diverse ideas and opinions
• Team-oriented, positively contributing to team morale and willing to help.
• Learning-Focused, finding ways to improve in their field and use positive constructive feedback to grow personally and professionally

Must Have Skills:

• Databricks expertise, Multi-Cloud Architecture & Deployment, CI/CD for Machine Learning, Python Programming & Framework Integration, Model Monitoring, Governance & Compliance