Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,396 of 189,070
Downloads: 440,149

Daily

Ranking: 7,554 of 189,059
Downloads: 211

Depended by

RankDownloadsName
8,505427,059katello
14,548140,950validate-website
25,97355,030esearchy
26,15954,425wayback_archiver
46,97824,544monet
66,76415,174hacker-gems
68,30914,671contentar
73,47813,150ronin-web-spider
120,0815,703spidr_cli
139,0504,345stupid_crawler
141,6194,201site_health
155,1743,573snackhack2

Depends on

RankDownloadsName
13,150,885,083bundler
151,131,046,573nokogiri
123357,913,029base64

Owners

#GravatarHandle
1iconpostmodern