Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,642 of 183,147
Downloads: 327,819

Daily

Ranking: 6,371 of 183,139
Downloads: 54

Depended by

RankDownloadsName
8,210367,707katello
13,860129,615validate-website
24,22453,296esearchy
25,85348,743wayback_archiver
46,89521,969monet
66,82913,512contentar
68,85912,955hacker-gems
98,7107,398ronin-web-spider
116,8655,325refract
119,4925,069spidr_cli
138,2513,895stupid_crawler
141,0443,758site_health
177,885908snackhack2

Depends on

RankDownloadsName
12,410,789,589bundler
20877,415,626nokogiri

Owners

#GravatarHandle
1iconpostmodern