Job Description
Senior Data Engineer (PySpark, Databricks & ADF)
About The Opportunity
A fast-growing firm in the Data Engineering & Cloud Analytics sector delivering enterprise-grade data platforms and analytics solutions. We architect and operate scalable Lakehouse pipelines on Azure to drive reporting, ML, and real-time insights for global customers. This is an on-site role in India focused on building robust, production-grade ETL and data infrastructure using PySpark, Databricks and Azure Data Factory.
Role & Responsibilities
About The Opportunity
A fast-growing firm in the Data Engineering & Cloud Analytics sector delivering enterprise-grade data platforms and analytics solutions. We architect and operate scalable Lakehouse pipelines on Azure to drive reporting, ML, and real-time insights for global customers. This is an on-site role in India focused on building robust, production-grade ETL and data infrastructure using PySpark, Databricks and Azure Data Factory.
Role & Responsibilities
- Design and implement scalable batch and streaming ETL pipelines on Azure using PySpark and Databricks, ingesting data into Delta Lake.
- Author and maintain Azure Data Factory pipelines for orchestration, parameterization, scheduling, and operational runbooks.
- Tune and optimize Spark jobs for performance and cost—partitioning, caching, shuffle optimization, and efficient file formats.
- Implement...
Apply for this Position
Ready to join PibyThree? Click the button below to submit your application.
Submit Application