Job Description

Position Overview

We are seeking a Data Engineer Engineer to support and enhance a Databricks‑based data platform during its development phase. This role is focused on building reliable, scalable data solutions early in the lifecycle—not production firefighting.

The ideal candidate brings hands‑on experience with Databricks, PySpark, Python, and a working understanding of Azure cloud services. You will partner closely with Data Engineering teams to ensure pipelines, notebooks, and workflows are designed for long‑term scalability and production readiness.

Key Responsibilities

  • Develop and enhance Databricks notebooks, jobs, and workflows
  • Write and optimize PySpark and Python code for distributed data processing
  • Assist in designing scalable and reliable data pipelines
  • Apply Spark performance best practices: partitioning, caching, joins, file sizing
  • Work with Delta Lake tables, schemas, and data models
  • Perform data validat...

    • Apply for this Position

    Ready to join Robert Half? Click the button below to submit your application.

    Submit Application