Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,508 of 196,721
Downloads: 502,354

Daily

Ranking: 6,678 of 196,694
Downloads: 217

Depended by

RankDownloadsName
8,515501,140katello
15,159147,152validate-website
26,58957,685wayback_archiver
27,07356,097esearchy
47,38626,049monet
65,92816,499ronin-web-spider
66,65516,238hacker-gems
69,38915,331contentar
119,7442,080ping_thing
120,7256,085spidr_cli
126,3115,509snackhack2
139,9544,613stupid_crawler
142,3574,478site_health

Depends on

RankDownloadsName
13,728,237,794bundler
161,260,225,676nokogiri
91517,245,292base64

Owners

#GravatarHandle
1iconpostmodern