Engagement Manager PySpark Data and Solution Architect

Description:

Job Description: PySpark Lead with 7+ years of experience, to drive the architecture, design development and optimization of big data processing solutions in the Asset and Wealth Management Industry Segment. The ideal candidate will have deep expertise in Apache Spark, Python, and distributed data processing while leading a project team of data analysts, business analysts/testers, domain consultants and engineers to deliver scalable data solutions. •Lead the end to end lifecycle covering architecture design, development, and deployment PySpark-based big data solutions. •Collaborate with and manage client project leadership, and key workstream leads to drive the solutions, strategize and navigate delivery and manage delivery outcomes •Architect and optimize ETL pipelines for structured and unstructured data. •Collaborate with Client, data engineers, data scientists, and business teams to understand requirements and provide scalable solutions. •Optimize Spark p...