Job Description

Data Quality Tester Databricks

(m/f/d)

Freelance/Contracting project remote Start date: asap Reference number: 859596/1

Diesen Job teilen oder drucken

Responsibilities

  • Develop and execute automated data and integration tests in Databricks (Python, PySpark, SQL)
  • Conduct end-to-end pipeline testing from SCADA through AMQP into Databricks, including verification of transformation logic and compliance with defined business rules
  • Capture, store, and prepare test results using Azure services (Data Lake, Blob Storage, SQL)
  • Integrate automated tests into CI/CD pipelines with Azure DevOps, collaborating closely with DevOps and Cloud teams to ensure continuous validation and monitoring
  • Work closely with Data Engineers, SCADA specialists, and Cloud architects, ensuring full documentation of all test cases, procedures, and outcomes for transparency and traceability

    • Profile ...

    Apply for this Position

    Ready to join Hays? Click the button below to submit your application.

    Submit Application