Kafka Engineer

We are looking for a skilled Kafka Engineer with hands-on experience in Confluent Platform to design, build, and maintain high-performance, real-time data streaming pipelines. The ideal candidate will have expertise in Kafka ecosystem components and be well-versed in deploying and scaling Kafka clusters, both on-prem and in cloud environments.

Responsibilities

Design, build, and manage Kafka and Confluent infrastructure for high throughput streaming applications; Implement Kafka Connect, Schema Registry, and KSQL (KSQLDB), FlinkSQL; Ensure high availability, performance tuning, and monitoring of Kafka clusters; Collaborate with data engineers and backend teams to integrate streaming pipelines with data lakes, warehouses; Set up and enforce Kafka security mechanisms (SASL, SSL, ACLs, RBAC); Create and manage CI/CD pipelines for Kafka components using tools like Git, Jenkins, etc.; Monitor and troubleshoot issues using tools like Confluent Control Center, DataDog

Requirements

Experience in Apache Kafka and Confluent Platform; Experience with Kafka Connect, Kafka Streams, Schema Registry, KSQL, and FlinkSQL; Strong background in Java or Python; Good understanding of stream processing and event-driven architecture; Hands-on experience with cloud platforms: AWS / Azure / GCP (esp. Confluent Cloud); Proficient in Kafka cluster deployment, tuning, and maintenance; Familiarity with CI/CD, Git, Helm, and Kubernetes

Nice to have

Knowledge of Terraform, Pulumi, or other Infra as Code tools; Exposure to DataOps / Data Engineering ecosystems