Living Patching Distributed ClickHouse with Shared IO and Network Interface over io_uring and eBPF
- Mentors
- vickieGPT
- Organization
- eunomia-bpf
- Technologies
- c, ebpf, io_uring, DBMS, RocksDB
- Topics
- linux, operating system, optimization, runtime, eBPF
This project aims to enhance the performance of distributed ClickHouse by leveraging io_uring and eBPF to optimize I/O operations across network interface cards (NICs) and solid-state drives (SSDs). Building upon previous efforts, we propose to develop a unified interface that abstracts the io_uring and eBPF interactions for SSD and NIC operations. Our solution seeks to live-patch ClickHouse I/O subsystems with io_uring methods and attach BPF programs at the edge of I/O operations with BPFTime to collect metrics and optimize performance in real-time.