Azure Data Bricks Engineer

Role : Azure data Bricks Engineer

Exp : 6 to 10

Location : Kolkata

JD:

• Design and implement scalable, secure, and high-performance data pipelines using Azure-native services and Azure Databricks.
• Develop and maintain ETL/ELT processes to ingest, transform, and integrate data from diverse sources.
• Build and optimize data workflows using Databricks notebooks, PySpark, and SparkSQL for both batch and streaming data.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver actionable insights.
• Monitor, troubleshoot, and resolve issues in data workflows and pipelines.
• Implement data governance, security, and privacy best practices.
• Contribute to DevSecOps practices, including CI/CD automation and infrastructure as code.
• Stay current with emerging Azure and Databricks technologies to drive continuous improvement.