Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,429 of 193,214
Downloads: 469,458

Daily

Ranking: 6,940 of 193,188
Downloads: 190

Depended by

RankDownloadsName
8,522459,056katello
14,906144,604validate-website
26,45256,195wayback_archiver
26,57755,793esearchy
47,13425,451monet
66,57515,809hacker-gems
68,96515,002contentar
70,08814,649ronin-web-spider
120,2085,931spidr_cli
129,8085,042snackhack2
139,1054,503stupid_crawler
141,5314,369site_health

Depends on

RankDownloadsName
13,441,039,624bundler
151,200,491,691nokogiri
109443,383,627base64

Owners

#GravatarHandle
1iconpostmodern