Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,367 of 186,961
Downloads: 414,318

Daily

Ranking: 8,668 of 186,954
Downloads: 155

Depended by

RankDownloadsName
8,491402,795katello
14,474134,861validate-website
25,38754,436esearchy
25,91752,843wayback_archiver
47,37523,271monet
67,79014,215contentar
68,23414,082hacker-gems
80,36511,036ronin-web-spider
120,1185,424spidr_cli
139,1214,145stupid_crawler
141,5324,010site_health
174,2732,105snackhack2

Depends on

RankDownloadsName
12,938,589,681bundler
161,065,616,469nokogiri
158277,719,701base64

Owners

#GravatarHandle
1iconpostmodern