Data Engineer

Overview

Our client is one of the biggest global energy company awarded as HR Asia Best Companies to Work for in Asia. One of the pioneers in shared services center in the Philippines.

Responsibilities

• Utilize Azure data storage accounts for organizing and maintaining data pipeline outputs. (e.g., Azure Data Lake Storage Gen 2 & Azure Blob storage).


• Collaborate with data scientists, data analysts, data architects and other stakeholders to understand data requirements and deliver high-quality data solutions.


• Optimize data pipelines in the Azure environment for performance, scalability, and reliability.


• Ensure data quality and integrity through data validation techniques and frameworks.


• Develop and maintain documentation for data processes, configurations, and best practices.


• Monitor and troubleshoot data pipeline issues to ensure timely resolution.
...