Data Pipeline Engineer

Role Overview:

We are seeking a highly skilled and experienced Senior Data Engineer to join our data engineering team. In this role, you will be responsible for designing, implementing, and optimizing real-time data pipelines that process terabytes of data.

The ideal candidate will have 3+ years of hands-on experience in data engineering and strong expertise in modern data platforms such as Databricks, PySpark, Delta Lake, Amazon S3, and Kafka.

This role offers an opportunity to work on cutting-edge technologies in a fast-paced environment with a strong focus on performance optimization, scalability and reliability.

Key Responsibilities:

- Design, build, and maintain robust, scalable, and efficient real-time data pipelines using Databricks, PySpark, Kafka, and Delta Lake.

- Architect and implement data ingestion pipelines for high-volume streaming and batch data into Amazon S3 and Delta Lake...