Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,385 of 187,603
Downloads: 423,964

Daily

Ranking: 6,308 of 187,591
Downloads: 126

Depended by

RankDownloadsName
8,486412,424katello
14,491137,279validate-website
25,64654,573esearchy
26,05153,327wayback_archiver
47,19123,847monet
67,54914,567hacker-gems
67,86014,471contentar
76,94412,011ronin-web-spider
120,0945,551spidr_cli
139,2054,235stupid_crawler
141,3704,111site_health
162,9752,913snackhack2

Depends on

RankDownloadsName
13,011,622,509bundler
161,089,000,676nokogiri
138306,382,816base64

Owners

#GravatarHandle
1iconpostmodern