New protocols for exascale data management with Rucio
- Mentors
- Martin Barisits, Mario Lassnig
- Organization
- CERN-HSF
Rucio is an open-source software framework that provides functionality to scientific collaborations to organize, manage, monitor, and access their distributed data and dataflows across heterogeneous infrastructures. Rucio was originally developed to meet the requirements of the high-energy physics experiment ATLAS and is continuously enhanced to support diverse scientific communities. This project seeks to enhance Rucio clients primarily by enabling the availability of different transfer tools to make them easier to use in heterogeneous environments. This project aims to implement protocol support for SSH, rsync, and rclone, along with the ability to choose the optimal transfer protocol based upon the local and remote configuration, unless specifically mentioned otherwise.