Azure Data Engineer

Mandatory Skill: Python, Pyspark, SQL, Azure, Databricks, ADF, ADLS

Exp: 6- 9 Years

Notice Period : Immediate to 30 days

Key Responsibilities:

- Design and develop scalable data pipelines and infrastructure on Azure.

- Optimize data storage and retrieval processes to ensure high performance and efficiency.

- Collaborate with data scientists, analysts, and business stakeholders to gather requirements and provide effective data solutions.

- Implement data integration and transformation processes using Azure data services.

- Monitor and troubleshoot data systems to ensure accuracy and reliability.

- Stay updated with industry best practices and emerging technologies in data engineering and Azure services.

Required Skills and Qualifications:

- Minimum of 6 years of experience in data engineering or related fields.

- Proficiency in SQL for data manipulation and querying.

- Strong programming skills in Python, with experience in data processing libraries.

- Familiarity with Azure cloud services, including Azure Data Factory, Azure Databricks, and Azure SQL Database.

- Experience with big data technologies, specifically Spark and PySpark, for data processing and analysis.

- Excellent problem-solving skills and ability to work collaboratively in a team environment.

Preferred Qualifications:

- Ability to work with cross-functional teams and communicate complex technical concepts to non-technical stakeholders.

- Experience with data visualization tools and reporting.

- Knowledge of machine learning concepts and frameworks is a plus.