Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,488 of 198,430
Downloads: 524,381

Daily

Ranking: 6,310 of 198,401
Downloads: 526

Depended by

RankDownloadsName
8,391537,588katello
15,347148,209validate-website
26,77558,316wayback_archiver
27,39856,307esearchy
47,88826,173monet
64,66517,281ronin-web-spider
67,24216,359hacker-gems
69,97515,445contentar
119,7442,080ping_thing
121,6406,133spidr_cli
125,7895,699snackhack2
140,6744,665stupid_crawler
143,2294,522site_health

Depends on

RankDownloadsName
13,939,528,074bundler
171,297,971,286nokogiri
88565,778,436base64

Owners

#GravatarHandle
1iconpostmodern