Job Description

Position: Data Engineer

Experience: 5–8 years

Location: Bengaluru


Must‑Have Skills

  • SQL (Advanced) – Joins, Window functions, query tuning.
  • Python – ETL scripting, PySpark, automation.
  • Apache Kafka – Real‑time ingestion, stream processing, Kafka Connect.

Data Pipeline & ETL Development

  • Design, develop, and maintain batch and real‑time ETL/ELT pipelines using Python, PySpark, and Kafka.
  • Build data ingestion frameworks to integrate RDBMS, APIs, Kafka streams, flat files, and cloud-native sources.
  • Implement and optimize CDC, incremental loads, SCD Type‑2, partitioning, and bucketing strategies.

Big Data Engineering

  • Develop and optimize pipelines using Spark, PySpark, Scala, Hive, Hadoop, and related tooling.
  • Handle large-scale distributed datasets with advanced performance techniques such as:
  • Broadcast joins
  • Shuffle optim...

Apply for this Position

Ready to join ACL Digital? Click the button below to submit your application.

Submit Application