Business Intelligence Analyst

BI/ Reporting Engineer at Arrow Electronics

Location: MY-Penang, Malaysia (Jalan Sultan Ahmad Shah)

Employment type: Full-time

Job category: Information Technology

Overview

Join Arrow Electronics as a BI/ Reporting Engineer. The role focuses on developing Spark-based data pipelines, performing data extraction, transformation, and loading (ETL), and enabling analytics across Azure Databricks environments.

What You’ll Be Doing

• Develop Spark applications using PySpark and Spark SQL in Databricks for data extraction, transformation, and aggregation from multiple file formats to analyze and transform data and uncover insights into customer usage patterns.
• Extract, transform, and load data from source systems to Azure Data Storage services using Azure Data Factory, T-SQL, Spark SQL, and U-SQL Azure Data Lake Analytics. Load data into Azure Data Lake, Azure Storage, Azure SQL, or Azure Synapse Analytics and process it in...