Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,403 of 192,104
Downloads: 459,225

Daily

Ranking: 9,179 of 192,085
Downloads: 57

Depended by

RankDownloadsName
8,500448,806katello
14,736142,919validate-website
26,40955,478wayback_archiver
26,41255,469esearchy
47,16925,080monet
66,67615,578hacker-gems
68,81414,869contentar
71,32414,087ronin-web-spider
120,1505,850spidr_cli
138,4744,479snackhack2
139,0764,444stupid_crawler
141,5274,310site_health

Depends on

RankDownloadsName
13,340,208,428bundler
151,177,825,969nokogiri
112415,278,011base64

Owners

#GravatarHandle
1iconpostmodern