Building platforms for reproducible AI research

Technologies
python, django, docker, aws
Topics
machine learning, artificial intelligence, computer vision, deep learning
Building platforms for reproducible AI research

CloudCV is an open-source cloud platform led by graduate students and faculty at the Machine Learning and Perception Lab at Georgia Tech, with the aim of building tools for reproducible and accessible AI research and development. At CloudCV, we are building tools that enable researchers to build, compare, and share start-of-the-algorithms. We believe that one shouldn’t have to be an AI expert to have access to cutting-edge vision algorithms. Likewise, researchers shouldn’t have to worry about building a service around their deep learning models to showcase and share it with others.

We are building a platform called EvalAI as a scalable solution for the research community to fulfill the critical need for evaluating machine learning models. This will help researchers, students, and data scientists to create, collaborate, and participate in AI challenges organized around the globe. By simplifying and standardizing the process of benchmarking these models, we seek to lower the barrier to entry for participating in the global scientific effort to push the frontiers of machine learning and artificial intelligence, thereby increasing the rate of measurable progress in this domain.

The platform is used by more than 20 organizations from industry and academia such as Facebook, eBay, IBM, Stanford, MIT, Georgia Tech, etc. It has hosted 50+ AI challenges with 5500+ users who have created 51000+ submissions. It has more than 90+ open-source contributors and 1.3M+ page views since its launch in 2017. Several research organizations like Mapiallary research, IBM research, etc. are using its forked version for hosting their internal challenges instead of reinventing the wheel.

2020 Program

Successful Projects

Contributor
Ayush Khare
Mentor
Deshraj Yadav, Rishabh Bhardwaj, Kartik Verma, Rishabh Jain
Organization
CloudCV
Enhancement in Code Upload Pipeline
As EvalAI hosts more code-upload challenges and researchers utilize the modular Kubernetes based infrastructure for hosting these challenges,...
Contributor
Kajol Kumari
Mentor
Shekhar Prasad Rajak, Deshraj Yadav, Sanjeev Singh, Mayank Lunayach, Rishabh Jain
Organization
CloudCV
Improvement In EvalAI front @CloudCV
This project mainly focuses adding some missing features and improving the frontend of the EvalAI.
Contributor
Khalid Riyaz
Mentor
Deshraj Yadav, Rishabh Jain, Ram Ramrakhya
Organization
CloudCV
Streamlining challenge creation on EvalAI
EvalAI is a platform to host and participate in AI challenges around the globe. To host a challenge, challenge creation is one of the core features...