Kafka Administrator

Kafka Admin

Primary skills:Kafka administration Experience with Confluent Platform Knowledge of Kubernetes (Kafka on K8s) Experience with DevOps tools and CI/CD pipelines Certification in Kafka / Confluent (nice to have) We are seeking an experienced Kafka Administrator to manage and maintain enterprise-level Apache Kafka clusters. The ideal candidate will be responsible for installation, configuration, monitoring, performance tuning, and ensuring high availability of Kafka infrastructure in distributed environments. Key Responsibilities Kafka Cluster Administration Install, configure, and maintain Apache Kafka clusters Manage Kafka brokers, topics, partitions, and replication Perform cluster upgrades, scaling, and capacity planning Monitoring & Performance Tuning Monitor Kafka cluster health using tools like: Prometheus, Grafana, Confluent Control Center Optimize broker performance, throughput, and latency Tune configurations for producers and consumers Data Streaming & Integration Manage real-time data pipelines using Kafka Handle integration with: Spark, Hadoop, Flink Databases & APIs Support streaming use cases and event-driven architecture Security & Governance Implement authentication and authorization (SSL, SASL, Kerberos) Configure ACLs (Access Control Lists) Ensure secure data transmission and compliance Replication & High Availability Ensure fault tolerance and data replication across brokers Configure multi-cluster setups (MirrorMaker, Cluster Linking) Handle disaster recovery strategies Troubleshooting & Support Diagnose and fix issues like: Broker failures Consumer lag Performance bottlenecks Analyze logs and perform root cause analysis Automation & DevOps Automate deployments using Ansible, Terraform, or scripts Manage CI/CD pipelines for Kafka environments Version control using Git Zookeeper / KRaft Management Manage Zookeeper clusters (if applicable) Configure Kafka in KRaft mode (Zookeeper-less architecture)