Principal Data Pipeline Architect

Job Title : Lead Data Engineer - Scala/Azure

Job location : Bengaluru

Exp : 6-12 years

Notice Period : 15-30 days

Position Overview : Looking for Software Development Engineer II position in Senior Data Engineer role with very good experience in Spark with Scala. Candidate should be able to work independently on end-to-end data engineering and data science use cases, be quick learner with some lead and mentoring experience, should have overall experience of minimum 7-8 years with minimum 5 to 6 Years in Hadoop and Spark OnPrem and Azure Cloud.

The ideal candidate will have strong expertise in Scala, Spark and SQL, building scalable and efficient data pipelines on Azure.

You will be responsible for

• Design, build, and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Databricks, and Spark.
• Develop and optimize spark data workflows using Scala for large-scale data processi...