Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,393 of 188,724
Downloads: 437,319

Daily

Ranking: 7,958 of 188,690
Downloads: 179

Depended by

RankDownloadsName
8,485425,104katello
14,502140,687validate-website
25,92454,949esearchy
26,13854,228wayback_archiver
47,04324,422monet
66,83615,099hacker-gems
68,20914,647contentar
74,28712,891ronin-web-spider
120,0355,686spidr_cli
138,9374,336stupid_crawler
141,4784,194site_health
156,1403,521snackhack2

Depends on

RankDownloadsName
13,114,528,140bundler
151,120,568,388nokogiri
127345,877,423base64

Owners

#GravatarHandle
1iconpostmodern