Pyspark Data Engineer

Job Title: Pyspark Data Engineer

Location: Pan India

Experience: 5–12 years

Role Overview-

- Good Python, Pyspark, Big Data experience
- Spark UI/Optimization/debugging techniques
- Good python scripting skills
- Intermediate SQL exposure – Subquery, Joins, CTE’s
- Database technologies
- AWS EMR, S3, IAM, Lambda, SNS, SQS
- Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL
- Experience working on Data Engineering projects
- Good Understanding of SQL
- Good understanding of Unix and HDFS commands
- Communication
- Experience working on Data Analytics and Pyspark
- Good Spark, Pyspark, Big Data experience
- Spark UI/Optimization/debugging techniques
- Good python scripting skills
- Intermediate SQL exposure – Subquery, Joins, CTE’s
- Database technologies
- AWS EMR, S3, IAM, Lambda, SNS, SQS