Data Engineering Developer (Python)

DATA ENGINEERING DEVELOPER (PYTHON)

This is for a full-time position.

Job Summary

The Data Engineering Developer will be responsible for designing and implementing data pipelines using the Microsoft Fabric Data Platform. This involves creating Notebooks to extract, transform, and load data. The role will receive technical guidance from a Senior Data Engineer based in Sydney and day-to-day support from the Data Team Leader.

Responsibilities

• Design, build, and maintain data pipelines to support data ingestion, preparation, and transformation processes across multiple layers.
• Develop and manage Notebooks for transforming data between Bronze, Silver, and Gold layers, ensuring proper version control and adherence to best practices.
• Implement and maintain diverse ingestion methods, such as Shortcuts and Database Mirroring, to enable efficient data integration.
• Conduct quality assurance and testing on inge...