Data Pipeline Manager

Job Summary:

We are seeking a skilled and motivated Data Engineer with hands-on experience in Databricks and Airflow to join our Engineering team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure that enable efficient data collection, processing, and storage using modern cloud-based technologies. The Data Engineer will work closely with Engineering, Data Scientists, Analysts, and Business Stakeholders to enable data-driven decision-making and actionable insights.

Key Responsibilities:

• Design, develop, and maintain efficient, reliable, and scalable data pipelines using Databricks, Apache Spark, Apache Airflow and related technologies to process large volumes of structured and unstructured data.
• Build and manage ETL workflows or jobs to transform raw data into optimized, analytics-ready datasets.
• Collaborate w...