cloud-based data platform developer

Job Title : Databricks Data Engineer — Azure Pipelines

Job Description: Develop a Cloud-Ready Databricks Environment

A skilled data professional is sought after to develop a cutting-edge cloud-based data platform on Databricks within an Azure environment. Our ideal candidate will be responsible for designing, building and maintaining large-scale, high-performance data systems that meet the organization's needs.

• Data Engineering Skills:


• Create scalable, efficient and well-maintained environments using latest technologies such as Spark MLlib or Delta Lake which enable us to optimize cost savings while minimizing operational overheads;


•    Design robust workflows leveraging DevOps practices with full automation of pipeline processes from code commits through deployment pipelines utilizing tools like Docker/Kubernetes/Waypoint etc., ensuring all required artifact management takes place via Jenk...