Event Streaming Architect

TCS Hiring for Integration - Kafka

Experience: 5 to 12 Years

Location: PAN India

Required Technical Skill Set

• Strong experience with Confluent Kafka (setup, configuration, development, monitoring)
• Proficiency in designing and developing real-time data integrations and event-driven architectures
• Experience with Kafka Connect, Schema Registry, KSQL, Kafka Streams
• Hands-on with integration platforms: Azure Integration Services, Azure APIM, WSO2, BizTalk, GoAnywhere
• Proficiency in Java/Scala/Python for Kafka client and stream processing
• Experience with CI/CD pipelines, DevOps tools (Bitbucket, Azure DevOps, Kubernetes)
• API development and management
• Strong troubleshooting, root cause analysis, and performance tuning skills

Must-Have

- Confluent Kafka platform expertise

- Real-time integration and event streaming

- API and microservices integration

- Incident, problem, and change management

- Automation of recovery for common Kafka failures (e.G., consumer lag, topic access)

- Strong analytical, troubleshooting, and communication skills

Good-to-Have

- Experience with OAuth, secret management, and secure API design

- Familiarity with observability, monitoring, and alerting for integration failures

- Experience in retail, supply chain, or e-commerce domains

- ITIL certification or similar process knowledge

Role Descriptions / Expectations from the Role

• Design, develop, and maintain integrations using Confluent Kafka and related technologies.
• Implement and manage real-time data pipelines, event streaming, and microservices integrations.
• Automate recovery workflows for common Kafka failures and manage OAuth secret renewal.
• Monitor integration jobs, APIs, and interfaces for failures or performance issues.
• Perform root cause analysis and implement corrective actions for integration incidents.
• Develop and manage APIs for internal and external consumption, ensuring security and scalability.
• Deploy integration components using CI/CD pipelines and automation tools.
• Collaborate with cross-functional teams (onshore/offshore) for solution design, sprint planning, and incident management.
• Maintain technical documentation, knowledge repositories, and support transition/KT activities.
• Ensure compliance with SLAs, KPIs, and service management procedures.