Big Data Engineer

Responsibilities

* Design & Develop new automation framework for ETL processing
* Support existing framework and become technical point of contact for all related teams
* Enhance existing ETL automation framework as per user requirements
* Performance tuning of spark, snowflake ETL jobs
* New technology POC and suitability analysis for Cloud migration
* Process optimization with the help of automation and new utility development
* Work in collaboration for any issues and new features
* Support any batch issue
* Support application team teams with any queries

Required Skills
* 7+ years of Data engineering experience
* Must be strong in UNIX Shell, Python scripting knowledge
* Must be strong in Spark
* Must have strong knowledge of SQL
* Hands-on knowledge on how HDFS/Hive/Impala/Spark works
* Strong in logical reasoning capabilities
* Should have working knowledge of Github, DevOps...