Azure Engineer

Key Responsibilities:

Design and deploy Azure data platform solutions including Azure Synapse Analytics, Azure Data Factory, Azure Data Lake Storage (ADLS Gen2), and Databricks/Apache Spark environments.

Build and maintain data ingestion pipelines using Azure Data Factory and Azure

Synapse pipelines to support batch and real-time data processing. Implement and manage Azure Databricks workspaces and Apache Spark clusters for large-scale data processing and analytics workloads.

Configure and optimize Azure Synapse Analytics dedicated SQL pools, serverless SQL pools, and Spark pools for data warehousing and analytics. Deploy and manage Azure Machine Learning workspaces, compute instances, and ML pipelines for model training and deployment.

Implement Azure OpenAI service integrations for generative AI and LLM-based applications within the data platform. Design and implement data lake architecture following medallion architecture (b...