Job Description
Job Summary:
We are looking for a highly skilled Senior Data Engineer with over 6 years of experience in data engineering and a strong focus on data migration projects. The ideal candidate will have deep expertise in Azure Data Factory (ADF), ETL/ELT processes, and Python/PySpark, with proven experience building scalable and efficient data pipelines across diverse data environments.
Key Responsibilities:
Design, develop, and implement end-to-end data pipelines across various sources and destinations.
Lead and support data migration initiatives from legacy to modern data platforms.
Develop robust ETL/ELT workflows using Azure Data Factory.
Write clean, efficient, and scalable code in Python or PySpark for data transformation and automation.
Utilize SQL for complex querying, data manipulation, and performance tuning.
Collaborate with DevOps teams to manage CI/CD pipelines using Azure DevOps.
Deploy and manage infrastructure using Terraform and other Ia...
We are looking for a highly skilled Senior Data Engineer with over 6 years of experience in data engineering and a strong focus on data migration projects. The ideal candidate will have deep expertise in Azure Data Factory (ADF), ETL/ELT processes, and Python/PySpark, with proven experience building scalable and efficient data pipelines across diverse data environments.
Key Responsibilities:
Design, develop, and implement end-to-end data pipelines across various sources and destinations.
Lead and support data migration initiatives from legacy to modern data platforms.
Develop robust ETL/ELT workflows using Azure Data Factory.
Write clean, efficient, and scalable code in Python or PySpark for data transformation and automation.
Utilize SQL for complex querying, data manipulation, and performance tuning.
Collaborate with DevOps teams to manage CI/CD pipelines using Azure DevOps.
Deploy and manage infrastructure using Terraform and other Ia...
Apply for this Position
Ready to join NR Consulting - India? Click the button below to submit your application.
Submit Application