Analytics Platform Engineer

JOB DESCRIPTION

Data Engineer

Designation – Data Engineer

Experience – 2+ Years

LocationJaipur

Job Summary:

We are seeking a highly skilled Data Engineer with deep expertise in Apache Kafka integration with Databricks, structured streaming, and large-scale data pipeline design using the Medallion Architecture. The ideal candidate will demonstrate strong hands-on experience in building and optimizing real-time and batch pipelines, and will be expected to solve real coding problems during the interview.

Job Description:

- Design, develop, and maintain real-time and batch data pipelines in Databricks.

- Integrate Apache Kafka with Databricks using Structured Streaming.

- Implement robust data ingestion frameworks using Databricks Autoloader.

- Build and maintain Medallion Architecture pipelines across Bronze, Silver, and Gold layers.

- Implement checkpointing, output modes, and appropriate proce...