Lead Consultant Data Engineer.

Job Description
Inviting applications for the role of Lead Consultant - Data Engineer.
In this role, a Data Engineer will leverage cloud technologies to manage and analyze their data. This role demands expertise in Databricks, Azure Data Factory (ADF), Python, PySpark and Unity Catalog to efficiently process and analyze large datasets. Data Engineer is responsible for designing and implementing scalable data pipelines, optimizing data workflows, ensuring data quality, collaborating with cross-functional teams, and leveraging cloud technologies to enhance data processing and analytics capabilities.
Responsibilities
- Data Pipeline Design and Development:
- Architect, build, and optimize data ingestion and transformation pipelines using Azure ADF and Databricks.
- Implement data integration and transformation solutions using Azure Databricks.
- Develop and deploy data models and solutions using Azure services.
- Data Management and Optimization:
- Pull, ingest,...