Data Engineer (PySpark & AWS )

Data Engineer (PySpark) ( Oil and Gas Project)

Responsibilities

Design, develop, test, and maintain scalable data architectures and data pipelines based on business requirements

Build and optimize ETL/ELT processes across multiple data layers within the Enterprise Data Hub (EDH)

Identify performance bottlenecks in existing data pipelines and lead optimization and automation initiatives

Support and resolve data integration issues at application, infrastructure, and network levels

Ensure data reliability, quality, and efficiency using appropriate programming languages and data processing tools

Collaborate with cross-functional teams to support analytics, reporting, and business use cases

Deploy changes to production environments and support live data operations

Qualifications

• Bachelor’s Degree in Computer Science, Information Technology , or a related fiel...