Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,379 of 185,290
Downloads: 384,849

Daily

Ranking: 3,819 of 185,279
Downloads: 1,392

Depended by

RankDownloadsName
8,376385,060katello
14,201132,086validate-website
24,79753,929esearchy
25,88050,779wayback_archiver
47,34822,420monet
67,44713,784contentar
69,06713,331hacker-gems
87,0559,317ronin-web-spider
117,2155,492refract
119,6605,244spidr_cli
138,4714,021stupid_crawler
141,2383,878site_health
176,5331,551snackhack2

Depends on

RankDownloadsName
12,698,073,204bundler
20984,759,155nokogiri
216186,453,790base64

Owners

#GravatarHandle
1iconpostmodern