Data Engineer - AWS MSK (Kafka Admin)

Job Title: Data Engineer - AWS MSK Specialist (Kafka Admin)

Job Summary:

We're looking for a skilled Data Engineer with expertise in AWS Managed Streaming for Apache Kafka (MSK) to design, build, and maintain high-performance data pipelines. You'll work closely with data architects and software engineers to ensure seamless data integration and streaming capabilities using AWS MSK.

Responsibilities:

- Design, develop, and manage real-time data pipelines using AWS MSK

- Integrate AWS MSK with various data sources and consumers

- Monitor and optimize AWS MSK cluster performance and costs

- Collaborate with DevOps to ensure optimal performance and uptime

- Implement security best practices for data streaming and storage

- Document technical processes and best practices

- Work with AWS services like S3, Glue, and Lambda for data processing and integration

...