CrawlerX - Extensible, Distributed, Scalable Crawler System
- Mentors
- Milindu Sanoj Kumarage, Sajitha Liyanage, EK
- Organization
- SCoRe Lab
Web crawling often called web scraping is a method of programmatically going over a collection of web pages and extracting data which is useful for data analysis with web-based data. CrawlerX is an extensible, distributed and a scalable platform for the every crawling needs.