senior big data architect for cloud platforms

Job Title

A prominent technology firm in Dubai is seeking a skilled Data Engineer to develop and maintain scalable data pipelines using the Cloudera Data Platform.

Description

This role demands expertise in data ingestion, transformation, and advanced processing techniques. Ideal candidates have a Bachelor's or Master's degree in Computer Science with over 3 years of experience in data engineering focused on PySpark.

Key Responsibilities:

• Data Ingestion: Designing and implementing efficient data ingestion processes to handle large-scale datasets.
• Data Transformation: Developing complex ETL workflows using PySpark for data cleansing, aggregation, and analysis.
• Advanced Processing Techniques: Utilizing machine learning algorithms to optimize business outcomes through predictive modeling and real-time analytics.

About Us