Kafka Technical Consultant

Tata Consultancy Services

Key Responsibilities

  • Design, deploy, and operate Apache Kafka / Confluent Platform / Confluent Cloud in large-scale, distributed environments.
  • Define and implement Kafka broker architecture, Schema Registry, Kafka Connect, and consumer group strategies.
  • Establish eventing standards, schema governance, topic naming conventions, retention policies, and platform guardrails.
  • Drive enterprise event-driven architecture (EDA) adoption beyond Kafka infrastructure (event design, patterns, and contracts).

Event-Driven Design & Stream Processing

  • Lead event-driven use case design and implementation, collaborating with domain and application teams.
  • Design and build stream processing applications using Flink, Kafka Streams (KStreams) or equivalent frameworks (Spark Streaming, Google Dataflow, etc.).
  • Support real-time data processing, enrichment, aggregation, and stateful streaming use cases.

Cloud & Kubernetes Platform Enablement

  • Deploy and manage Kafka and streaming workloads on Kubernetes (GKE preferred; AKS/EKS acceptable).
  • Use Helm, Kustomize, and Kubernetes Operators for repeatable and scalable deployments.
  • Integrate Kafka platforms with cloud-native services such as compute, storage, and messaging systems.

Location

Melbourne

Job Function

TECHNOLOGY

Role

Consultant

Job Id

420252

Desired Skills

AWS | Docker | Kafka