Kafka Technical Consultant
Tata Consultancy Services
Key Responsibilities
- Design, deploy, and operate Apache Kafka / Confluent Platform / Confluent Cloud in large-scale, distributed environments.
- Define and implement Kafka broker architecture, Schema Registry, Kafka Connect, and consumer group strategies.
- Establish eventing standards, schema governance, topic naming conventions, retention policies, and platform guardrails.
- Drive enterprise event-driven architecture (EDA) adoption beyond Kafka infrastructure (event design, patterns, and contracts).
Event-Driven Design & Stream Processing
- Lead event-driven use case design and implementation, collaborating with domain and application teams.
- Design and build stream processing applications using Flink, Kafka Streams (KStreams) or equivalent frameworks (Spark Streaming, Google Dataflow, etc.).
- Support real-time data processing, enrichment, aggregation, and stateful streaming use cases.
Cloud & Kubernetes Platform Enablement
- Deploy and manage Kafka and streaming workloads on Kubernetes (GKE preferred; AKS/EKS acceptable).
- Use Helm, Kustomize, and Kubernetes Operators for repeatable and scalable deployments.
- Integrate Kafka platforms with cloud-native services such as compute, storage, and messaging systems.
Location
Melbourne
Job Function
TECHNOLOGY
Role
Consultant
Job Id
420252
Desired Skills
AWS | Docker | Kafka