AVP - Databricks Architect

Assistant Vice President – Lead Databricks Architect

Shift Type: UK Shift

Work Model: 5 Days Work From Office

Lead the design and delivery of large-scale data engineering solutions on Azure and Databricks Lakehouse. This role focuses on scalable data pipelines, Unity Catalog governance, ML/LLM enablement, and driving engineering excellence.

Key Responsibilities

• Architect, build, and optimize data pipelines using Databricks, ADF, PySpark, and Unity Catalog.
• Implement data quality, lineage, privacy, and security governance across data assets.
• Integrate data from multiple sources to support analytics, ML feature stores, and enterprise insights.
• Operationalize ML models using MLflow and enhance pro...