Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,397 of 189,628
Downloads: 443,537

Daily

Ranking: 7,789 of 189,601
Downloads: 163

Depended by

RankDownloadsName
8,524428,899katello
14,593141,239validate-website
26,02655,110esearchy
26,18254,602wayback_archiver
47,00324,620monet
66,77815,221hacker-gems
68,41314,692contentar
73,01713,322ronin-web-spider
120,1445,719spidr_cli
139,0724,358stupid_crawler
141,5494,220site_health
152,9443,675snackhack2

Depends on

RankDownloadsName
13,191,433,711bundler
151,142,117,467nokogiri
118370,442,096base64

Owners

#GravatarHandle
1iconpostmodern