Lead Data Software Engineer (Spark/Scala/Databricks)

Lead Data Software Engineer (Spark / Scala / Databricks)

Join EPAM Systems as a Lead Data Engineer to transform data pipelines from Oracle to Databricks. As a forward‑thinking Scala expert, you will deliver critical curated data solutions across a dynamic, agile, client‑focused environment based in Madrid, Málaga, or remotely across Spain.

Responsibilities

• Develop, monitor, and operate the most critical curated data pipeline at the client – Sales Order Data (incl. post‑order information such as shipment, return, payment).
• Consult with analysts, data scientists, and product managers to build and continuously improve a “Single Source of Truth” KPI for business steering such as the central Profit Contribution measurement (PC II).
• Redevelop legacy pipelines into new, advanced, and standard versions that are easy to maintain and scalable for future demands.
• Leverage and improve a cloud‑based tech stack that includes AWS, D...