Data Engineer

Job Description – Data Engineer

As a Data Engineer you will be a member of the Data Governance and Technology development team, with specific focus developing data solutions for Non-Financial Risk Technology. In this role you will be primarily responsible for the development of data workflows, pipelines, views, and stored procedures, in addition to performing data analysis, and monitoring and tuning queries and data loads. You will be working closely with data providers, data scientists, data developers, and data analytics teams to facilitate the implementation of client-specific business requirements and requests.

YOUR KEY RESPONSIBILITIES:

• Develop ETLs to source data from various source system to DB2 target and hive tables.

• Create stored procedures, triggers, and views on our DB2-based Data mart

• Write complex SQL queries to analyze data and de-bug data related issues

• Create informatica and talend jobs to do various data transformation from source to target

• Write Shell/Perl/Python scripts to achieve complex task

• Debug Production issues and perform RCA to provide permanent solution to bugs

• Communicate with downstream users to understand the Data servicing requirements

• Use GIT and Jenkins for Automated code deployment to higher env

• Should have good knowledge in Hadoop/Big Data platform

• Experience with Cloud Data Platforms like Snowflake , Databricks, AWS or Azure is a plus

• Experience with Reporting tool like Tableau ,cognos is a plus

SKILLS / QUALIFICATIONS

• Bachelor’s degree in Computer Science, Software Engineering, Information Technology, or related field required

• At least 5+ years of experience in data development and solutions in highly complex data environments with large data volumes

• At least 5+ years of SQL / PLSQL experience with the ability to write ad-hoc and complex queries to perform data analysis

• At least 5+ years of experience developing complex stored procedures, triggers, MQTs and views on IBM DB2 (experience with v10.5 a plus)

• Strong analytical skills, including a thorough understanding of how to interpret customer business requirements and translate them into technical designs and solutions

• Experience with both Waterfall and Agile development methodologies

• Strong communication skills both verbal and written. Capable of collaborating effectively across a variety of IT and Business groups, across regions, roles and able to interact effectively with all levels.

• Self-starter. Proven ability to manage multiple, concurrent projects with minimal supervision. Can manage a complex ever changing priority list and resolve conflicts to competing priorities.

• Strong problem-solving skills. Ability to identify where focus is needed and bring clarity to business objectives, requirements and priorities.