AI Infrastructure Engineer (Databricks)

Build the backbone for our GenAI initiatives. We need an engineer to manage Vector Search and Feature Stores. You will prepare our data so that our AI models can read and understand the enterprise.

Key Responsibilities

• Prepare GenAI-compatible datasets: manage vector embeddings and index with Databricks Vector Search.
• Access and utilize data assets from the Databricks Marketplace for model training.
• Integrate Power BI/Looker with Databricks using Unity Catalog security.
• Prepare data for RAG (Retrieval Augmented Generation) architectures.
• Collaborate with data stakeholders to implement Delta Sharing.

Must-Have Skills & Experience

• 3+ years of hands-on experience in data engineering or a similar role.
• Strong programming and debugging skills in Python.
• Solid hands-on experience with PySpark for large-scale data processing.
• Proven experience building ETL/ELT pipelines on Dat...