ETL Data Automation

Job Title: ETL Data Automation Engineer Position

Ford Direct

Fulltime with AB2

8+ years

25 - 30 LPA

Essential Job Functions:

Ø Create and execute scenarios to test various API. Preparing request block and analyzing the responses in JSON/XML formats.

Ø Validate the flow of data from disparate sources ingested into multiple databases inside Databricks, post which data is transformed by pipelines and workflows built within Azure Databricks and Azure Data Factory (ETL process).

Ø Thoroughly test the ETL rules built for data transformation & complex business rule built to merge consumers.

Job Summary:

This position is for an Offshore ETL Data Tester to support FordDirect's OIP Project (One Integrated Platform). This individual will be responsible for creating and executing various test cases that support the processing of data related to Ford and Lincoln consumers. The candidate should be a data enthusiast who has a zeal to work with data, analyze, understand and improve data processing techniques. The primary focus on this testing is to verify the accuracy of this data as various business rules are applied mainly within Azure Databricks and partly inside Azure Data Factory. This individual will be expected to understand the data flow, validate the content, understand and test the business rules involved in merging consumers and build an automation framework that supports a number of data quality checks.

Job Title:

Automation Engineer

Minimum Qualifications and Job Requirements:

Ø 3+ years working with Azure Databricks

Ø 1+ years working with Azure Data Factory

Ø 3+ years strong experience in writing complex SQL queries.

Ø 3+ years of experience in Python programming to deal with data or PySpark experience is a must.

Ø 3+ years of experience in building test automation for data processing within data intensive projects.

Original NSR:

NSR-8924

Other Responsibilities:

Ø Maintain technology expertise, keeping current with evolving testing tools, techniques, and strategies to improve the overall testing efficiency, processes, and best practices.

Ø Maintain a focus on customer-service, efficiency, quality, and growth.

Ø Safeguard the company's assets.

Ø Adhere to the company's compliance program.

Ø Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices