Data Engineer

Job title : Data Engineer 

Location :  Bangalore - Hybrid

Experience :  4+ Years

Key Responsibilities:  

• Administer and manage Databricks clusters, workspaces, and resources. 
• Monitor platform health, availability, and performance. 
• Develop and maintain data pipelines for ingesting, transforming, and loading data into Databricks. 
• Optimize ETL processes for efficiency and scalability. 
• Collaborate with data scientists and analysts to build and optimize data processing and analytics workflows using Databricks notebooks. 
• Develop and implement data transformation and data analysis solutions. 
• Implement and manage data lakes within Databricks for structured and unstructured data storage. 
• Ensure data lake security and access controls. 
• Identify and address performance bottlenecks in Databricks workl...