Open source repositories tagged with #web-spider, ranked by health score.
A next-generation crawling and spidering framework.