Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,514 of 196,125
Downloads: 495,733

Daily

Ranking: 8,113 of 196,106
Downloads: 81

Depended by

RankDownloadsName
8,550491,104katello
15,102146,980validate-website
26,53557,512wayback_archiver
26,98756,067esearchy
47,30826,009monet
66,55516,217hacker-gems
66,89916,103ronin-web-spider
69,22515,330contentar
119,7442,080ping_thing
120,4546,083spidr_cli
126,5105,457snackhack2
139,6194,610stupid_crawler
142,0254,476site_health

Depends on

RankDownloadsName
13,667,363,143bundler
151,249,086,568nokogiri
95502,392,567base64

Owners

#GravatarHandle
1iconpostmodern