WebCollector-master

代码说明：

应用背景WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup a multi-threaded web crawler in less than 5 minutes.关键技术WebCollector致力于维护一个稳定、可扩的爬虫内核，源码中集成了Jsoup，可进行精准的网页解析；便于开发者学习并进行开发。内核具有健壮的扩展性，用户可以在此基础上开发自己想要的爬虫。