Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,502 of 197,051
Downloads: 509,586

Daily

Ranking: 5,895 of 197,010
Downloads: 531

Depended by

RankDownloadsName
8,435519,403katello
15,223147,532validate-website
26,62757,940wayback_archiver
27,18256,177esearchy
47,52426,097monet
65,16216,865ronin-web-spider
66,80016,287hacker-gems
69,55615,366contentar
119,7442,080ping_thing
121,1486,099spidr_cli
125,9795,594snackhack2
140,3244,628stupid_crawler
142,8234,489site_health

Depends on

RankDownloadsName
13,792,501,566bundler
161,271,730,347nokogiri
91532,871,606base64

Owners

#GravatarHandle
1iconpostmodern