Job Description
Description
:What we're looking for:
Overall 10 years of experience in Industry including 6+Years of experience as developer using Databricks/Spark Ecosystems.
Hands on experience on Unified Data Analytics with Databricks, Databricks Workspace User Interface, Managing Databricks Notebooks, Delta Lake with Python, Delta Lake with Spark SQL.
Good understanding of Spark Architecture with Databricks, Structured Streaming. Setting Microsoft Azure with Databricks, Databricks Workspace for Business Analytics, Manage Clusters In Databricks, Managing the Machine Learning Lifecycle
Hands on experience Data extraction (extract, Schemas, corrupt record handling and parallelized code), transformations and loads (user - defined functions, join optimizations) and Production (optimize and automate Extract, Transform and Load)
TECHNICAL SKILLS
Spark Data Frame API
Python for ...
Apply for this Position
Ready to join Arrow Components (M) Sdn Bhd? Click the button below to submit your application.
Submit Application