Contributor
Nguyen Le Vu Long

Remoting over Apache Kafka with Kubernetes features


Mentors
Supun Wanniarachchi, Ankit Jain, Oleg Nenashev, Pham Vu Tuan, Andrey Falko
Organization
Jenkins project

Current version of Remoting over Apache Kafka plugin requires users to manually configure the entire system which includes Zookeeper, Kafka and remoting agents. It also doesn't support dynamic agent provisioning so scalability is harder to achieve. This project aims to solve two problems:

  1. Out-of-the-box solution to provision Apache Kafka cluster. More specifically, users can connect with a Kafka server seamlessly by either local binary files, Kubernetes container or from a Software-as-a-Service provider.
  2. Dynamic agent provisioning in a Kubernetes cluster. This can be done by implementing Cloud API or integrate Kafka agent launcher in Kubernetes plugin.