Job Description
oDevelop and maintain ETL pipelines to support data processing, analytics, and visualization needs. oCollaborate with cross-functional teams to understand business requirements and provide data-driven solutions. oManage multiple disparate data sources and integrate them into a cohesive data platform and dashboards. oDevelop and implement validation processes to ensure data accuracy and consistency. oUtilize PySpark, Spark, SQL to optimize data processing and querying performance. oDesign and implement scalable, fault-tolerant data processing systems in Amazon Web Services oWork independently and be comfortable walking through code with the team lead. oDocument all processes, code, and work, as well as be willing to ask questions and raise issues when roadblocks are encountered oExtensive experience in developing API services for data consumption oWorking knowledge in AWS infrastructure with hands-on knowledge in Glue, Redshift, Amazon Dynamo DB or any other NoSQL or Columnar databases ...
Apply for this Position
Ready to join ADP? Click the button below to submit your application.
Submit Application