Job Description

Description

:

What we're looking for:

  • Overall 10 years of experience in Industry including 6+Years of experience as developer using Databricks/Spark Ecosystems.

  • Hands on experience on Unified Data Analytics with Databricks, Databricks Workspace User Interface, Managing Databricks Notebooks, Delta Lake with Python, Delta Lake with Spark SQL.

  • Good understanding of Spark Architecture with Databricks, Structured Streaming. Setting Microsoft Azure with Databricks, Databricks Workspace for Business Analytics, Manage Clusters In Databricks, Managing the Machine Learning Lifecycle

  • Hands on experience Data extraction (extract, Schemas, corrupt record handling and parallelized code), transformations and loads (user - defined functions, join optimizations) and Production (optimize and automate Extract, Transform and Load)

  • TECHNICAL SKILLS

  • Spark Data Frame API

  • Python for ...

  • Apply for this Position

    Ready to join Arrow Components (M) Sdn Bhd? Click the button below to submit your application.

    Submit Application