Senior Data Bricks Specialist in Montreal

Elevate your career as a Senior Data Bricks/Scala/Spark Engineering Specialist in Montreal, QC. This hands-on role focuses on migrating complex regulatory reporting pipelines to a modern cloud platform.
In this contract position, you will design, implement, test, and reconcile production pipelines using Databricks, Snowflake, and Azure. Your expertise in Scala, Spark, SQL, and orchestration tools like Airflow will be crucial in ensuring compliance with strict parity requirements. This is an opportunity to make a significant impact on regulatory reporting as part of the migration project.
Key Responsibilities:
• Design and implement data pipelines for regulatory reporting
• Migrate legacy ETL processes to Databricks and Snowflake
• Write and optimize Spark applications using Scala
• Conduct testing and validate against legacy outputs
• Develop unit and integration tests ensuring data quality
Requirements:
• Proven experience with Scala and Spark in production<...