Job Description

About the Company



Role Senior Data Engineer



Location Pan India



About the Role



Data Engineer with minimum 8 years of experience in Big Data technologies.



Responsibilities


  • Develops and maintains scalable data pipelines.
  • Understand business requirements and data model and create ETL code.
  • Ability to work independently on spark pipelines.
  • Proficiency in writing complex business logic in pyspark and spark SQL.
  • Thorough understanding of spark clusters and parallel processing.
  • Able to write test cases for unit testing the ETL code.
  • Worked in past on reusable functions and use modularized approach in coding.
  • Experience working on Athena creation of tables indexes writing complex SQL queries etc.
  • Should have worked on relational databases like oracle SQL server etc and NoSQL databases like Mongodb to fetch data from and load data.



Mandatory Skills


  • Databricks



Preferred Skills


  • Experience on AWS IAM role creation policy creation.
  • Experience on Docker Image Creation changes as needed.
  • Experience on Camunda and orchestration in camunda.

Apply for this Position

Ready to join ? Click the button below to submit your application.

Submit Application