Job Description

About the Role

We are looking for a Data Engineer with strong hands-on expertise in Databricks and the Azure Data ecosystem. This role focuses on building and optimizing large-scale data pipelines, troubleshooting performance issues, and ensuring high data quality and governance across our cloud data platforms.

Key Responsibilities
  • Design, develop, and optimize scalable data pipelines using Databricks (PySpark/Spark SQL) .
  • Implement and tune data workloads using Azure Data Factory , Azure Synapse Analytics , and Microsoft Fabric .
  • Apply best practices in Delta Lake , including performance tuning, partitioning, indexing, and caching.
  • Troubleshoot complex ingestion, transformation, orchestration, and performance issues.
  • Implement data governance, lineage, and security using Unity Catalog and Azure capabilities.
  • Automate workflows using CI/CD, Databricks Jobs, and REST APIs...

Apply for this Position

Ready to join Senpiper PTY LTD? Click the button below to submit your application.

Submit Application