CrawlScript / WebCollector
WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup a multi-threaded web crawler in less than 5 minutes.
- Repository stars
- 3,076All-time #20,112
- Fork
- 1,418
- Last push
- updated 8 months ago
- Repository created
- since 2014
About
WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup a multi-threaded web crawler in less than 5 minutes.Summarised by AI from the README; the original prevails
Author description: WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup a multi-threaded web crawler in less than 5 minutes.
Basic listing based on official public information; functionality has not been independently evaluated.
Check before adopting
- No pushes for over 6 months (last 2026-02-10); check whether it is maintained.
- Platform
- Not verified
- Pricing
- Pricing not verifiedCheck current official software, hosting, model and infrastructure pricing.
- Maintenance notes
- Not verified