Lead Data Software Engineer (Spark/Scala/Databricks)

Lead Data Software Engineer (Spark / Scala / Databricks) Join EPAM Systems as a Lead Data Engineer to transform data pipelines from Oracle to Databricks. As a forward‑thinking Scala expert, you will deliver critical curated data solutions across a dynamic, agile, client‑focused environment based in Madrid, Málaga, or remotely across Spain. Responsibilities Develop, monitor, and operate the most critical curated data pipeline at the client – Sales Order Data (incl. post‑order information such as shipment, return, payment). Consult with analysts, data scientists, and product managers to build and continuously improve a “Single Source of Truth” KPI for business steering such as the central Profit Contribution measurement (PC II). Redevelop legacy pipelines into new, advanced, and standard versions that are easy to maintain and scalable for future demands. Leverage and improve a cloud‑based tech stack that includes AWS, Databricks, Kubernetes, Spark, Airflow, Python, and Scala. Requirement...