Data engineer

In depth knowledge and understanding: Data governance and data management frameworks BI and Warehouse design Movement of data into the Cloud using the following tools Apache Kafka, Storm, Flume for ingesting data or Amazon Web Services (AWS) Cloud Development Kit (CDK) Operating with real-time streams, data warehouse queries, JSON, CSV, raw data Scripting Data Pipelines for scheduled movement of data Designing and developing ETL/ELT processes and data pipelines Experience working with Azure Dev Ops Exploratory Data Analysis - EDA SQL Microsoft SQL Server No SQL Microsoft SQL Server Python (Py Spark) C#, Json- calling APIs Power Shell Kafka Scala Splunk Elk Stack Data warehousing solutions Data Cleansing Terraform Responsibilities Work as part of an agile data engineering team Ensure that data systems meet the companys regulatory commitments, and that data is reliable and efficient Support best busin...