Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,503 of 197,085
Downloads: 510,080

Daily

Ranking: 7,621 of 197,066
Downloads: 124

Depended by

RankDownloadsName
8,423521,478katello
15,229147,544validate-website
26,63957,951wayback_archiver
27,19056,180esearchy
47,57426,097monet
65,20416,895ronin-web-spider
66,93416,287hacker-gems
69,68115,372contentar
119,7442,080ping_thing
121,2576,099spidr_cli
126,0235,598snackhack2
140,3834,628stupid_crawler
142,8834,489site_health

Depends on

RankDownloadsName
13,796,160,121bundler
161,272,378,399nokogiri
91533,861,260base64

Owners

#GravatarHandle
1iconpostmodern