Job Description

SCADA Data Quality Automation Tester (Databricks & Azure)

(m/f/d)

Freelance/Contracting project Remote Start date: asap Reference number: 857104/1

Diesen Job teilen oder drucken

Responsibilities

  • Develop and maintain automated test scripts in Databricks (using Python, PySpark, or SQL)
  • Validate JSON messages received via AMQP for structure, completeness, and accuracy
  • Implement data quality checks (, schema validation, range checks, anomaly detection)
  • Ensure data integrity and reliability by designing and executing automated checks on incoming data streams and recording results in Azure DevOps
  • Validate data flow from SCADA through AMQP to Databricks
  • Integrate tests into CI/CD pipelines for continuous validation using Azure DevOps

    • Profile

  • Strong experience with Databricks, PySpark and JSON message handling
  • Knowledge of Azure services (Data Lake, Blob Storage, Functions)
  • Experience in setting up and running automated tests in Cloud Environments
  • Proficiency in Python for scripting and automation
  • Familiarity with CI/CD tools (Azure DevOps)

    • Benefits

  • Start date: asap
  • Remote-option

    • Apply for this Position

    Ready to join ? Click the button below to submit your application.

    Submit Application