Senior Data Pipeline Engineer

Experience Level: 9-12 years

Key Responsibilities

• Senior Data and AI Engineering lead for large and complex data ecosystem leveraging data domains, data products, cloud and modern technology stack
• Real-Time Data Streaming: Design, build and maintain scalable and robust real-time data streaming pipelines using technologies such as Apache Kafka, AWS Kinesis, Spark streaming, or similar.
• Senior Data and AI Engineering lead responsible for Implementing Data and AI pipelines that bring together structured, semi-structured and unstructured data to support AI and Agentic solutions. This Includes pre-processing with extraction, chunking, embedding and grounding strategies to get the data ready.
• Design and Develop Data and AI-driven systems to improve data capabilities, ensuring compliance with industry best practices.
• Design and Develop data domains and data products for various consumption archetypes including Reporting...