Big Data Engineer

Job Title: Big Data Engineer
Location: Malvern, PA hybrid (local only)

Duration: Long Term



Qualification: (+ minimum experience)



AWS Skills - Glue Lambda S KMS Stepfunctions General Skills - Data Transformation Tools like Pandas and Pyspark Cloudformation Cloudblocks Python Bitbucket/Github Coder (optional) Java (optional) Golang (optional) Cobol/JBL (optional)

Responsibilities

Collaborate on the Smartstream cash reconciliation platform, known as TLM, to support data integration and transformation workflows.

Design and implement ETL processes using tools like AWS Glue, Spark, or Python to transform raw data into structured formats compatible with Smartstream's ingestion requirements.

Conduct data mapping exercises to align legacy data structures with modernized attributes stored in S buckets, ensuring consistency and accuracy across systems.

Ensure data quality ...