Scalable Data Download Functionality into the Gen3 Python SDK & CLI
- Mentors
- Michael Lukowski
- Organization
- Center for Translational Data Science
- Technologies
- python, json, restful api, Pytest
- Topics
- concurrency, parallelism
This project tries to integrate data download client functionality into the Gen3 Python SDK & CLI, to provide a single tool for interacting with Gen3. The project is implemented by using python modules such as multithreading or multiprocessing to enable asynchronous download of multiple files.