Sr Data Engineer

Role: Sr Data Engineer

Experience: 3+yrs

Location: Bengaluru

Notice Period: Immediate Joiner or max 15days preferred

Skills: Hive, Spark, Airflow, Oracle OCI Big Data, Data Lake, Sqoop, File Processing, Pipeline Support

Job Description

We are looking for a Data Engineer with 3+ years of experience in building, maintaining, and supporting large-scale data pipelines. The role requires strong hands-on experience with Hive, Spark, and Airflow, along with exposure to Oracle OCI Big Data Services and Data Lake environments.

Key Responsibilities

• Develop and optimize ETL/ELT pipelines using Spark, Hive, and Airflow
  
• Manage data ingestion workflows including Sqoop transfers (Oracle ↔ Hive) and file-based processing
  
• Monitor, debug, and support production data pipelines and batch workflows
  
• Work with OCI Big Data Service, Data Lake, and distributed storage systems
  
• Perform performance tuning and troubleshoot issues across Spark jobs, Hive queries, and Airflow DAGs
  

Required Skills

• 3+ years of Data Engineering experience
  
• Strong in Spark (PySpark/Scala), Hive, SQL, and Linux
  
• Hands-on experience with Airflow, Sqoop, and file ingestion
  
• Experience working on OCI Big Data / Data Lake platforms
  
• Strong debugging and pipeline support capabilities
  

Nice to Have

• Knowledge of Informatica, HDFS, or Cloud Data Integration tools
  
• Good understanding of CI/CD, Git, and scripting