Senior Data Engineer

We’re Hiring: Senior & Lead Data Engineers

Location: Whitefield, Bangalore

Platform Specialization: Databricks

Project Scope: Complex DWH & Migration initiatives across the full data engineering lifecycle

Are you passionate about building scalable data pipelines, optimizing performance, and solving real-world data challenges? We’re looking for hands-on Data Engineers and Lead engineers (5–10 years experience) who thrive in fast-paced environments and bring deep expertise in SQL, Python, Spark, Databricks, and cloud-native data platforms.

Role Overview

Senior Data Engineers (5–8 years):

 Build and optimize robust data pipelines for ingestion, transformation, and analytics

 Work across structured and semi-structured data sources, ensuring performance and reliability

 Collaborate with cross-functional teams to deliver scalable solutions on Databricks

 Strong coding skills in SQL, Python, and Spark are a must

 Experience in data validations, reconciliation, and quality checks across ingestion and transformation stages

Lead Data Engineers (8–10 years):

 Own solution architecture and consultative delivery for complex DWH and migration projects

 Be hands-on with Databricks, Spark, and orchestration frameworks

 Guide teams on best practices, performance tuning, and modular design

 Engage with stakeholders to define scope, KPIs, and delivery milestones

 Lead validation strategies and ensure data integrity across migration workflows

Core Skills & Competencies

Must-Have Technical Skills:

 Advanced SQL (window functions, CTEs, performance tuning)

 Python (data manipulation, modular design, error handling)

 Advanced Apache Spark Programming

 Databricks (Notebooks, Delta Lake, Job Orchestration, Unity Catalog, Delta Live Tables, DB Asset Bundles, Lakehouse Architecture, Workspace Management, Cluster Configuration, MLflow Integration, and Role-Based Access Control)

 CI/CD pipelines, version control (Git), and testing frameworks

 Experience with cloud platforms (Azure, AWS, or GCP)

Software Engineering Fundamentals:

 Clean code practices and modular design

 Agile delivery and sprint planning

 Debugging, logging, and exception handling

 Code reviews and mentoring junior engineers

 Understanding of system design and scalability

Bonus Skills:

 Exposure to data modeling (dimensional, star/snowflake schemas)

 Familiarity with data governance, lineage, and cataloging tools

 Prior experience in large-scale data migration projects and validation frameworks