Sr. Data Engineer -Python

<p style="margin-bottom:11px"><b>Sr. Data Engineer </b></p> <p style="margin-bottom:11px"><b>EXP 6 +Yrs </b></p> <p style="margin-bottom:11px"> </p> <p style="margin-bottom:11px"><b>Notice Immediate - 15Days Max</b></p> <p style="margin-bottom:11px"><b>Location Bangalore</b></p> <p style="margin-bottom:11px">JD - </p> <p style="margin-bottom:11px">Primary Skill : Python, PySparl SQL & ETL<br /> <br /> We are seeking a Sr. Data Engineer own and operate a large-scale data processing and reconciliation platform for an eCommerce enterprise. The role involves execution, support and enhancement of real-time data ingestion and batch processing ETL dataflows (SQL, Python, PySpark, Hive), and SLA based execution of SQL based financial report generation. <br /> <br /> You will be responsible for triaging reconciliation issues, performing deep root cause analysis (RCA) using data from MySQL, HBase, and HDFS, and implementing fixes with a focus on process automation, data lineage (DataHub), and platform reliability.<br /> <br /> Key Responsibilities:<br /> <br /> <br /> Execute large scale data processing and report generation for in order to drive successful financial reconciliation on monthly basis. Work closely with the Finance Controllers.<br /> Perform RCA, issue triaging and resolve anomalies<br /> Build and monitor data quality, lineage, and SLA adherence across systems<br /> Enable observability through monitoring dashboards and diagnostics<br /> <br /> Required Skills:<br /> <br /> Strong hands-on experience with: SQL, Python( or PySpark) Based ETL for a Data Lake environment (or a large DWH platform)<br /> Proficiency in SQL and Python (PySpark) performance tuning, and building complex business logic<br /> Knowledge of data lineage, data governance frameworks, and BI tools (Tableau, ClickView)<br /> Fast learner and willing to learn new data analytics tools, basic java programming and microservices architecture</p>