crawler-commons:基于 Java 的网络爬虫通用组件项目

A set of reusable Java components that implement functionality common to any web crawler