Big Data Solutions Engineer (PySpark)

Job Description: Data Engineer – PySpark

Exp: 3-8yrs

Location: Pune, Indore

Interview Date: 29th Jan

Role Overview

• A Data Engineer with PySpark expertise is responsible for designing, building, and optimizing scalable data pipelines for large-scale data processing. The role involves working with distributed systems, big data technologies, and cloud platforms to enable analytics and data-driven decision-making.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark
• Process large volumes of structured and semi-structured data
• Optimize Spark jobs for performance, scalability, and reliability
• Develop batch and streaming data processing solutions
• Integrate data from databases, APIs, files, and event streams
• Collaborate with analytics and data science teams
• Prepare technical doc...