Lead Data Engineer –Azure

Urgently looking for highly experienced Lead Data Engineer with a proven track record in Azure data technologies and team leadership. The ideal candidate will have 12+ years of experience, including 7+ years of expertise in Azure Data Factory, Azure Databricks, Data Modeling, PySpark, SQL Queries, and Unity Catalog. This is a remote role requiring excellent leadership, technical, and problem-solving skills.

Key Responsibilities

Leadership: Lead and mentor a team of data engineers, ensuring project deliverables are met with high quality and on time.

Architecture and Design: Design and implement scalable, secure, and efficient data solutions using Azure services.

Development: Build, monitor, and optimize complex data pipelines and workflows using Azure Data Factory and Azure Databricks.

Data Modeling: Design robust data models to support analytical and operational needs.

Programming: Write and optimize SQL queries and utilize PySpark for large-scale data processing and transformation.

Data Governance: Implement data security and governance frameworks using Unity Catalog and ensure compliance with organizational standards.

Collaboration: Work closely with business stakeholders, data scientists, and analysts to understand requirements and translate them into technical solutions.

Problem-Solving: Troubleshoot and resolve data-related issues to ensure seamless operations and data availability.

Process Improvement: Advocate and implement best practices in data engineering, coding standards, and Agile methodologies.

Qualifications and Skills

Experience:

12+ years of professional experience in data engineering and analytics.

7+ years of hands-on expertise in Azure Data Factory, Azure Databricks, Data Modeling, PySpark, SQL Queries, and Unity Catalog.

Leadership: Proven experience in leading and managing engineering teams, with the ability to inspire and guide team members effectively.

Technical Expertise:

Deep understanding of Azure cloud services and data ecosystems.

Strong knowledge of ETL/ELT processes and big data architectures.

Proficient in Python and SQL for data manipulation and analysis.

Soft Skills:

Excellent communication and collaboration abilities in a remote environment.

Problem-solving mindset with a focus on innovation and continuous improvement.

Ability to manage multiple priorities and meet tight deadlines.

Preferred: Familiarity with Agile and DevOps practices.

Interested candidates kindly share their updated profile at- [email protected]