Contributor
Qifan Yu

ShenYu: logging-kafka plugin


Mentors
Yonglun Zhang, Liang Liu
Organization
Apache Software Foundation
Technologies
java
Topics
web, Gateway
ShenYu is a widely used program for limiting, fusing, forwarding, routing, monitoring, and so on. Since ShenYu clusters are able to support a large volume of internet business, it is crucial to decouple the systems and data streams. The Kafka plugins as a high-throughput distributed messaging system will enable ShenYu to have excellent horizontal scalability, scaling to millions of messages per second. It enables the data stream to communicate with less than 10 ms latency, almost real-time message transmission. In this feature, the logging-Kafka plugin will be able to store ShenYu’s logs and take the ShenYu gateway log information, write it to Kafka and display it. The module could be activated as a “Shenyu-plugin”.