Zettamine - Sr. Data Engineer

Job Title: Senior Data Engineer (PySpark)
Experience: 5 to 8 Years
Location: Bangalore

Job Summary:
We are looking for a highly skilled and experienced Senior Data Engineer to join our team in Bangalore. The ideal candidate will have a strong background in building scalable and high-performance data pipelines using PySpark and the Apache ecosystem. This role involves close collaboration with Data Scientists, Analysts, and cross-functional teams to drive robust data solutions.

Key Responsibilities:
Design, develop, and optimize distributed data pipelines using PySpark.
Work with Apache tools such as Hadoop, Hive, HDFS, and others for large-scale data ingestion, transformation, and processing.
Ensure the performance, reliability, and scalability of ETL workflows in production environments.
Collaborate with stakeholders to gather requirements and deliver scalable data solutions.
Implement robust data quality checks and lineage tracking for auditabi...