Job Description
Role 1: Pod Lead – Senior Data Engineer / Data Architect
Experience: 5–6 Years
Location - Bangalore
Role Summary
We are seeking a Senior Data Engineer / Data Architect to lead a Data Engineering pod and drive the design, development, and optimization of scalable data platforms on Azure Databricks . This role combines hands-on engineering, architecture ownership, and technical leadership, ensuring high-quality, performant, and governable data solutions.
Key Responsibilities
- Lead and own end-to-end delivery of data engineering solutions for the assigned pod
- Design scalable, secure, and high-performance data architectures using Azure Databricks
- Define and implement metadata-driven data frameworks for ingestion, transformation, and orchestration
- Architect and manage Unity Catalog for data governance, access control, and lineage
- Build and optimize ADF pipelines for batch and incremental data ingestion
- Perform data modeling (dimensional, fact-based, and analytical models) for downstream analytics
- Drive performance tuning for Spark jobs, SQL queries, and data pipelines
- Conduct code reviews , enforce engineering best practices, and mentor junior engineers
- Collaborate with product owners, architects, and stakeholders to translate business requirements into technical solutions
- Ensure reliability, scalability, and observability of data pipelines in production
Required Skills & Qualifications
- 5–6 years of experience in Data Engineering, with at least 2 years in a senior or lead role
- Advanced expertise in Azure Databricks (Spark optimization, cluster tuning, Delta Lake)
- Strong hands-on experience with Unity Catalog and enterprise data governance
- Proven experience with Azure Data Factory (ADF)
- Strong understanding of metadata-driven frameworks
- Solid experience in data modeling for analytics and reporting
- Strong Spark/SQL performance tuning skills
- Experience with code reviews, CI/CD practices, and pod-level ownership
- Excellent communication and technical leadership skills
Good to Have
- Experience with cloud data architecture on Azure
- Exposure to streaming frameworks or real-time data processing
- Prior experience leading small to mid-sized data engineering teams
Apply for this Position
Ready to join ? Click the button below to submit your application.
Submit Application