Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,541 of 193,756
Downloads: 475,275

Daily

Ranking: 6,940 of 193,649
Downloads: 305

Depended by

RankDownloadsName
8,646463,848katello
14,964144,937validate-website
26,48956,402wayback_archiver
26,66355,833esearchy
47,10625,602monet
66,49315,904hacker-gems
69,12315,022contentar
69,62414,860ronin-web-spider
120,3455,946spidr_cli
129,2515,101snackhack2
139,2664,513stupid_crawler
141,7294,376site_health

Depends on

RankDownloadsName
13,494,238,297bundler
151,212,292,481nokogiri
106457,600,575base64

Owners

#GravatarHandle
1iconpostmodern