AWIGN EXPERT- Azure Data Engineer

About the Role:

Location: Remote

Timings: Full Time (As per company timings)

Notice Period: (Immediate Joiner - Only)

Experience: 3-6 Years

JD:

The role will leverage & enhance existing technologies in the area of Data and analytics  Solutions like Power BI, Azure data engineering technologies, Teradata/Snowflake, and other Azure services. 

The role will be responsible for developing and supporting IT products and solutions using  these technologies and deploying them for business users 

Technical Requirements:

• 3 to 6 Years of IT & Azure Data engineering technologies experience 
• Prior experience in ETL, data pipelines, and data flow techniques using Azure Data  Services 
• Working experience in Python, Py Spark, Azure Data Factory, Azure Data Lake  Gen2, Databricks, Azure Synapse, and file formats like JSON & Parquet. 
• Experience in creating ADF Pipelines to source and process data sets. 
• Experience in creating Databricks notebooks to cleanse, transform, and enrich data sets.
• Development experience in the orchestration of pipelines 
• Good understanding of SQL, Databases, and data warehouse systems, preferably  Teradata
• Experience in deployment and monitoring techniques
• Working experience with Azure DevOps CI/CD pipelines to deploy Azure resources. 
• Experience in handling operations/Integration with source repository 
• Must have good knowledge of Data Warehouse concepts and Data Warehouse modelling. 
• Working knowledge of SNO, M, S, including resolving incidents, handling Change requests /Service requests, and reporting on metrics to provide insights. 
• Collaborate with the project team to understand tasks to model tables using data warehouse best practices and develop data pipelines to ensure the efficient delivery of data. 

Non-technical requirement: 

• Work with project leaders to model tables using data warehouse best practices and develop data pipelines to ensure the efficient delivery of data. 
• Think and work agile, from estimation to development, including testing,  continuous integration, and deployment.
• Manage numerous project tasks concurrently and strategically, prioritizing when necessary. 
• Proven ability to work as part of a virtual team of technical consultants working from different locations (including onsite) around project delivery goals. 

Technologies:

• Azure data factory 
• Azure Data bricks 
• Azure Synapse 
• PySpark/SQL 
• ADLS, BLOB 
• Azure DevOps with CI/CD implementation.