Dataplane migration for Apache Kafka communications: Leveraging Java19’s Project Loom.
- Mentors
- Ali Ok ., Christoph Stäbler, Pierangelo Di Pilato, Matthias Wessendorf
- Organization
- CNCF
- Technologies
- java, kubernetes, apache kafka
- Topics
- cloud, cloud-native
Overview:
In the current scenario, the Knative Eventing Kafka Broker's data-plane communication with Apache Kafka for consuming and producing records is done via the Vert.x-Kafka-client library which is basically a wrapper for communications with Apache Kafka inside the Vert.x threading model.
Objictive:
This project idea aims to implement the Knative Kafka Broker data-plane communication with the native Apache-kafka-client library working on Java 19 and evaluate OpenJDK 19's Project Loom and leverage its virtual threads for efficient and concurrent communication with the Apache Kafka cluster.