Data Engineer

Role - Azure Databricks

Location - Bangalore, Chennai, Delhi, Mumbai, Pune, Hyderabad

Exp range - 5+ years

• Architecture of Azure Databricks, differentiating between the control plane and data plane.
• SDLC of Azure Databricks. Describe the role of Databricks Workspaces, Notebooks, and Jobs How to create workspaces, providing access to users.
• Setup and Provisioning How to configure and manage different types of Databricks clusters (e.g., all-purpose, job, high concurrency).
• How to secure data in Databricks. How to manage cluster resources & optimize cluster performance.
• Integration and Other Azure Services, Azure Databricks integrate with Azure Data Lake Storage (ADLS)? & Azure Synapse Analytics? How to implement CI/CD pipelines for Databricks notebooks and jobs using Azure DevOps Monitor and log Databricks workloads for performance and error analysis.
• Monitoring and Cost Mana...