Job Description
Position: Data Engineer
Experience: 5–8 years
Location: Bengaluru
Must‑Have Skills
SQL (Advanced) – Joins, Window functions, query tuning.
Python – ETL scripting, Py Spark, automation.
Apache Kafka – Real‑time ingestion, stream processing, Kafka Connect.
Data Pipeline & ETL Development
Design, develop, and maintain batch and real‑time ETL/ELT pipelines using Python, Py Spark, and Kafka.
Build data ingestion frameworks to integrate RDBMS, APIs, Kafka streams, flat files, and cloud-native sources.
Implement and optimize CDC, incremental loads, SCD Type‑2, partitioning, and bucketing strategies.
Big Data Engineering
Develop and optimize pipelines using Spark, Py Spark, Scala, Hive, Hadoop, and related tooling.
Handle large-scale distributed datasets with advanced performance techniques such as:
Broadcast joins
Shuffle optimization
Data skew resolution
Caching & indexing
Cloud Engineering (AWS / Azure)
Build end-to-end data solutions...
Experience: 5–8 years
Location: Bengaluru
Must‑Have Skills
SQL (Advanced) – Joins, Window functions, query tuning.
Python – ETL scripting, Py Spark, automation.
Apache Kafka – Real‑time ingestion, stream processing, Kafka Connect.
Data Pipeline & ETL Development
Design, develop, and maintain batch and real‑time ETL/ELT pipelines using Python, Py Spark, and Kafka.
Build data ingestion frameworks to integrate RDBMS, APIs, Kafka streams, flat files, and cloud-native sources.
Implement and optimize CDC, incremental loads, SCD Type‑2, partitioning, and bucketing strategies.
Big Data Engineering
Develop and optimize pipelines using Spark, Py Spark, Scala, Hive, Hadoop, and related tooling.
Handle large-scale distributed datasets with advanced performance techniques such as:
Broadcast joins
Shuffle optimization
Data skew resolution
Caching & indexing
Cloud Engineering (AWS / Azure)
Build end-to-end data solutions...
Apply for this Position
Ready to join ACL Digital? Click the button below to submit your application.
Submit Application