Job Description

We are seeking an experienced Databricks Developer / Data Engineer to design, develop, and optimize data pipelines, ETL workflows, and big data solutions using Databricks. The ideal candidate should have expertise in Apache Spark, PySpark, SQL, and cloud-based data platforms (Azure, AWS, GCP). This role involves working with large-scale datasets, data lakes, and data warehouses to drive business intelligence and analytics.

Key Responsibilities:

  • Design, build, and optimize ETL and ELT pipelines using Databricks and Apache Spark
  • Work with big data processing frameworks (PySpark, Scala, SQL) for data transformation and analytics
  • Implement Delta Lake architecture for data reliability, ACID transactions, and schema evolution
  • Integrate Databricks with cloud services like Azure Data Lake, AWS S3, GCP BigQuery, and Snowflake
  • Develop and maintain data models, data lakes, and data warehouse solutions
  • Optimize Spa...

Apply for this Position

Ready to join Pathfinders Global P Ltd? Click the button below to submit your application.

Submit Application