Big Data Admin

Title: Big Data Admin

Location: Bengaluru

Summary:

As a Custom Software Engineer, you will engage in the development of custom software solutions that are designed to meet specific business needs. Your typical day will involve coding, enhancing components, and collaborating with various teams to ensure the delivery of scalable and high-performing solutions. You will utilize modern frameworks and agile practices to streamline processes and improve overall efficiency in software development.

Roles & Responsibilities:

- Design and build end-to-end data pipelines

- Unit testing of the pipelines and UAT support

- Understand the current codes, pipelines and scripts in production and fix the issues

- Adapt changes to the existing scripts, codes and pipelines

- Reviewing design, code and other deliverables created by your team to guarantee high-quality results

- Capable enough to own the PoCs and deliver the results in reasonable time

- Accommodate and accomplish any ad-hoc assignments

- Challenging current practices, giving feedback to colleagues and encouraging software development best-practices to build the best solution for our users

- Expected to be an SME.

- Collaborate and manage the team to perform.

- Responsible for team decisions.

- Engage with multiple teams and contribute on key decisions.

- Provide solutions to problems for their immediate team and across multiple teams.

- Facilitate knowledge sharing sessions to enhance team capabilities.

- Mentor junior team members to foster their professional growth.

Professional & Technical Skills:

- Must To Have Skills: Proficiency in Big Data Administration.

- Strong understanding of data processing frameworks such as Apache Hadoop and Apache Spark.

- Experience with database management systems including NoSQL and SQL databases.

- Familiarity with cloud platforms and services for big data solutions.

- Ability to implement data governance and security measures.