high performance data solutions specialist

Job Title:

Data Engineering Professional

Description

We are seeking a seasoned data engineer to design, build, optimize and maintain scalable data pipelines for production environments. The ideal candidate will have strong hands-on experience in big data processing, pipeline optimization and deployment using modern data engineering tools and frameworks.

Key Responsibilities

• Create robust, scalable data pipelines using Python and PySpark

Detailed Job Description:

The successful candidate will be responsible for designing developing and maintaining robust scalable high-performance big-data processing systems leveraging advanced technologies like Apache Spark (PySpark) Jupyter Notebooks SQL NoSQL databases Git GitHub Apache Airflow Jenkins etc.
The role involves handling structured unstructured datasets performing EDA identification of patterns anomalies quality...