Data Engineer II (azure)

<p>Position: Data Engineer II (azure)</p> <p> </p> <p>Job Description:</p> <p>Primary Skills: Data Engineering, DevOps Automation; CI/CD; Databricks; Azure DevOps; Powershell etc.<br /> <br /> The Databricks Platform Engineer II contributes to the expanding and optimizing our data<br /> and data pipeline architecture, as well as optimizing data flow and collection for cross<br /> functional teams. They will contribute to our data initiatives and will ensure optimal data<br /> delivery architecture is consistent throughout ongoing projects. They engage through the<br /> entire lifecycle of a project from data mapping, data pipelines, data modeling, and finally<br /> data consumption. They must be self-directed and comfortable supporting the data needs<br /> of multiple teams, systems, and products. They will learn to optimize or even re-design our<br /> company's data architecture to support our next generation of products and data<br /> initiatives. They can take on smaller projects from start to finish, work on problems of<br /> moderate scope where analysis of situations or data requires a review of a variety of factors<br /> and trace issues to their source. They develop solutions to a variety of problems of<br /> moderate scope and complexity.<br /> <br /> <b>Duties & Responsibilities:</b><br /> Build, Maintain and Support Databricks compute and storage<br /> Solves simple to moderate application errors, resolves application problems,<br /> following up promptly with all appropriate customers and IT personnel.<br /> Reviews and contributes to QA test plans and supports QA team during test<br /> execution.<br /> Participates in developing data transformation and data pipelines.<br /> Ensures change control and change management procedures are followed within<br /> the program/project as they relate to requirements.<br /> Develops BI datasets, reports, dashboards to support decision-making within the<br /> business and IT.<br /> Able to interpret requirement documents, contributes to creating functional design<br /> documents as a part of data development life cycle.<br /> Documents all phases of work including gathering requirements, joining<br /> relationship diagrams, creating database diagrams, report layouts and other<br /> program technical specifications using current specified design standards for new<br /> or revised solutions.<br /> Relates information from various sources to draw logical conclusions.<br /> Conducts unit testing on ELT and report development.<br /> Conducts data lineage and impact analysis as a part of the change management<br /> process.<br /> Conducts data analysis (SQL, Excel, Data Discovery, etc.) on legacy systems and<br /> new data sources.<br /> Contributes to documenting reporting requirements through engagement with<br /> business process SMEs.<br /> Creates source to target data mappings for data pipelines and integration activities.<br /> Assists in identifying the impact of proposed application<br /> development/enhancements projects.<br /> Performs data profiling and process analysis to understand key source systems and<br /> uses knowledge of application features and functions to assess scope and impact<br /> of business needs.<br /> Works with business users to design, develop, test, and implement business<br /> intelligence solutions in the Data & Analytics Platform.<br /> Implement and maintain data governance policies and procedures to ensure data<br /> quality, security and compliance<br /> Ensure operational stability of a 24/7/365 grocery retail environment by providing<br /> technical support, system monitoring, and issue resolution which may be required<br /> during off-hours, weekends, and holidays as needed.<br /> </p> <p><b>Qualifications:</b><br /> Bachelors Degree in Computer Science or Technical field; equivalent<br /> trainings/certifications/experience equivalency will be considered<br /> 3 or more years of equivalent experience in relevant job or field of technology<br /> 3+ years of Databricks<br /> 3+ years of Terraform<br /> </p> <p><b>Preferred Qualifications</b><br /> Masters Degree in relevant field of study preferred; Additional trainings or<br /> certifications in relevant field of study preferred<br /> Experience in Agile teams and or Product/Platform based operating model.<br /> Experience in retail or grocery preferred</p>