Azure Databricks Engineer

<ul> <li data-olk-copy-source="MessageBody">5+ years' experience in SQL (Expert)</li> <li>4+ years of experience in Azure Databricks with PySpark</li> <li>4+ years of experience in Azure Cloud platform</li> <li>3+ years of experience in ADF (Azure Data Factory), ADLS Gen 2 and Azure SQL</li> <li>2+ years of experience in Databricks workflow & Unity catalog</li> <li>2+ years of experience in Python programming & package builds</li> <li>Experience in data ingestion, cleansing, and transformation processes from various structured and unstructured data sources like Cassandra & Mark Logic and on-prem Mainframe sources using Databricks/PySpark supporting batch and near-real-time ingestion, transformation, and processing.</li> <li>Manage job scheduling, orchestration, and monitoring (e.g., using Azure Data Factory, Airflow, or Databricks Workflows).</li> <li>A...