Job Description
Job Purpose
The Senior Data Engineer will design, construct, and maintain scalable data management systems using Azure Databricks. This role involves supervising the upkeep of existing data infrastructure workflows and creating data processing pipelines utilizing Databricks Notebooks, Spark SQL, Python, and other Databricks tools. The Senior Data Engineer will oversee and lead the module through planning, estimation, implementation, monitoring, and tracking.
Desired Skills and experience
• 7+ years of experience in software development with a focus on data projects using Strong Python Coding skills, PySpark and associated frameworks.
• Hands-on SQL coding skills with RDMS or NoSQL databases.
• Hands-on experience with IBM MQ administration in enterprise environments.
• Strong expertise in: MQ clustering & distributed messaging, MQ object management ,SSL/TLS configuration, Messaging patterns (pub/sub, point-to-point, request/response)
• Good experience of Brok...
The Senior Data Engineer will design, construct, and maintain scalable data management systems using Azure Databricks. This role involves supervising the upkeep of existing data infrastructure workflows and creating data processing pipelines utilizing Databricks Notebooks, Spark SQL, Python, and other Databricks tools. The Senior Data Engineer will oversee and lead the module through planning, estimation, implementation, monitoring, and tracking.
Desired Skills and experience
• 7+ years of experience in software development with a focus on data projects using Strong Python Coding skills, PySpark and associated frameworks.
• Hands-on SQL coding skills with RDMS or NoSQL databases.
• Hands-on experience with IBM MQ administration in enterprise environments.
• Strong expertise in: MQ clustering & distributed messaging, MQ object management ,SSL/TLS configuration, Messaging patterns (pub/sub, point-to-point, request/response)
• Good experience of Brok...
Apply for this Position
Ready to join Acuity Analytics? Click the button below to submit your application.
Submit Application