Advanced Data Engineer (Databricks, Python, PySpark)

Overview

Position Name – Advanced Data Engineer (Databricks, Python, PySpark)

Type of hiring – Fulltime

Location – Remote Canada

Need strong Sr profiles. Add more for this.

Job Description

Must have:

• Programming Languages: Proficient in Python and PySpark with a strong understanding software engineering best practices.
• Cloud Computing: Utilize Azure cloud-based data platforms, specifically leveraging Databricks and Delta Live Tables for data engineering tasks, while effectively utilizing services related to storage, compute, and security.
• Data Pipelines: Design, build, and maintain robust and scalable and automated data pipelines for batch and streaming data ingestion of data and processing (Data bricks workflow).
• Data Architecture and Modeling: Design and implement robust data models and architectures that align with business requirements and su...