Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,375 of 186,833
Downloads: 409,470

Daily

Ranking: 7,286 of 186,696
Downloads: 178

Depended by

RankDownloadsName
8,487398,145katello
14,462133,565validate-website
25,23254,338esearchy
25,88852,340wayback_archiver
47,49422,895monet
67,83414,005contentar
68,64013,779hacker-gems
82,66710,411ronin-web-spider
120,2425,332spidr_cli
139,2864,077stupid_crawler
141,8443,938site_health
175,9511,836snackhack2

Depends on

RankDownloadsName
12,901,817,099bundler
181,052,236,410nokogiri
162262,964,334base64

Owners

#GravatarHandle
1iconpostmodern