Kafka Developer

As a Senior Associate in Data Engineering , you'll design and optimize scalable data pipelines, streaming solutions, and data models across enterprise platforms. You'll work with Kafka for real-time streaming, leverage Dataiku and Spark on Cloudera for advanced data workflows, and use Python/PySpark and SQL for data transformations. You'll also mentor junior engineers, enforce best practices, and collaborate with architects and business stakeholders to ensure robust, efficient, and scalable solutions:

Data Streaming & Real-Time Processing (Kafka)

Design and implement streaming data ingestion pipelines using Kafka producers, consumers, and topics
Manage partitions, consumer groups, offsets, and retention strategies for scalability and fault tolerance
Integrate Kafka with downstream platforms such as Spark, Cloudera, or Snowflake
Implement monitoring, error han...