Software Development Engineer III

Roles & Responsibilities:

• Define and drive the test automation strategy for data pipelines, ensuring alignment with enterprise data platform goals.
• Lead and mentor a team of data QA/test engineers, providing technical direction, career development, and performance feedback.
• Own delivery of automated data validation frameworks across real-time and batch data pipelines using Databricks and AWS services.
• Collaborate with data engineering, platform, and product teams to embed data quality checks and testability into pipeline design.
• Design and implement scalable validation frameworks for data ingestion, transformation, and consumption layers.
• Automate validations for multiple data formats including JSON, CSV, Parquet, and other structured/semi-structured file types during ingestion and transformation.
• Automate data testing workflows for pipelines built on Databricks/Spark, integrated with AWS services like S3, G...