Data engineering Leader

Company Name: Our client a new GCC in Bangalore.

Role: Data engineering Leader

Location: Bangalore (Work from Office)

Key Responsibilities

• Lead a technical team effectively while fostering collaboration across onshore and offshore teams.
• Maintain a hands-on approach by actively writing and reviewing code daily.
• Ensure team adherence to established data governance policies and standards.
• Oversee the design, development, and maintenance of new and existing data pipelines.
• Conduct regular code reviews and provide mentorship to the data engineering team.
• Collaborate with the Head of Engineering to align with platform strategy and roadmap.
• Support the Head of Engineering in managing software engineers as needed.

Qualifications and Skills

• Bachelor's, Master's, or Ph.D. in Computer Science or a related discipline.
• A minimum of 8 years of experience in data engineering or related fields.
• Proven expertise in working with Databricks.
• Advanced knowledge of Azure Data Lake, Parquet, and Delta tables.
• Strong experience with structured and semi-structured datasets.
• Comprehensive understanding of ELT/ETL processes and their implementation in data pipelines.
• Proficiency in developing, implementing, and integrating notebooks within data pipelines.
• Expertise in configuring and managing data ingestion pipelines using Azure Data Factory or Databricks.
• Extensive experience in programming languages such as Python, R, and SQL.
• Familiarity with consuming and processing data from secure REST APIs.
• Experience with data visualization tools like Power BI or Spotfire.
• Knowledge of Azure DevOps (or similar tools) and CI/CD methodologies.
• Strong communication skills with the ability to propose and discuss solutions effectively with both technical and business stakeholders.
• Capability to present project updates and metrics to senior management.