Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,394 of 191,455
Downloads: 454,272

Daily

Ranking: 9,017 of 191,429
Downloads: 136

Depended by

RankDownloadsName
8,471445,910katello
14,679142,360validate-website
26,18355,336esearchy
26,22155,200wayback_archiver
46,95324,942monet
66,57715,449hacker-gems
68,66714,779contentar
71,82913,812ronin-web-spider
119,9615,808spidr_cli
138,8444,418stupid_crawler
141,3274,281site_health
144,3584,111snackhack2

Depends on

RankDownloadsName
13,290,634,251bundler
151,166,708,441nokogiri
112401,137,935base64

Owners

#GravatarHandle
1iconpostmodern