Data Engineer

JOB DESCRIPTION

Data Engineer

Designation – Data Engineer

Experience – 2+ Years

LocationJaipur

Job Summary:

We are seeking a highly skilled Data Engineer with deep expertise in Apache Kafka integration with Databricks, structured streaming, and large-scale data pipeline design using the Medallion Architecture. The ideal candidate will demonstrate strong hands-on experience in building and optimizing real-time and batch pipelines, and will be expected to solve real coding problems during the interview.

Job Description:

•Design, develop, and maintain real-time and batch data pipelines in Databricks.

•Integrate Apache Kafka with Databricks using Structured Streaming.

•Implement robust data ingestion frameworks using Databricks Autoloader.

•Build and maintain Medallion Architecture pipelines across Bronze, Silver, and Gold layers.

•Implement checkpointing, output modes, and appropriate processing mod...