ETL Testing, SQL with Python good to have

Position Description:

Experience: 3-9 Years
Title: ETL Testing Engineer
Shift: 1PM to 10PM
Main location: Bangalore/Chennai
Employment Type: Full Time

We are seeking an experienced ETL/SQL/Python Testing Engineer to design, develop, and execute test cases for data pipelines, ETL processes, and database systems. The ideal candidate will possess strong expertise in SQL querying, ETL validation, Python scripting, and test automation to ensure data accuracy, completeness, and optimal performance.

Your future duties and responsibilities:

Develop and execute ETL test cases to validate data extraction, transformation, and loading processes.

Perform ETL pipeline testing in an ADB (Azure Databricks) environment.

Write complex SQL queries to verify data integrity, consistency, and correctness across source and target systems.

Automate ETL testing workflows using Python, PyTest, or similar testing frameworks.

Conduct data reconciliation, schema validation, and comprehensive data quality checks.

Identify and report data anomalies, performance issues, and defects.

Collaborate closely with Data Engineers, Analysts, and Business Teams to understand data requirements.

Design and maintain test datasets for validation activities.

Implement CI/CD pipelines for automated ETL testing (e.g., Jenkins, GitLab CI).

Document test results, defects, and detailed validation reports.

Required qualifications to be successful in this role:

ETL Testing: Strong hands-on experience with Informatica, Talend, SSIS, Databricks, or similar ETL tools.

SQL: Advanced SQL skills including joins, aggregations, subqueries, and stored procedures.

Python: Proficiency in Python for automation, including Pandas, PySpark, and PyTest.

Databases: Experience with RDBMS (Oracle, SQL Server, PostgreSQL) and NoSQL databases (MongoDB, Cassandra).

Big Data (Good to Have): Experience with Hadoop, Hive, Spark, Kafka.

Testing Tools: Familiarity with Selenium, Airflow, Great Expectations, or similar frameworks.

Version Control: Git, GitHub/GitLab.

CI/CD: Experience with Jenkins, Azure DevOps, or similar tools.

Skills: