Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,387 of 190,317
Downloads: 449,577

Daily

Ranking: 7,521 of 190,280
Downloads: 290

Depended by

RankDownloadsName
8,504437,066katello
14,636141,803validate-website
26,10055,248esearchy
26,21254,882wayback_archiver
46,97624,807monet
66,56715,370hacker-gems
68,54714,740contentar
72,31213,603ronin-web-spider
119,9235,777spidr_cli
138,8854,391stupid_crawler
141,4824,249site_health
148,9943,863snackhack2

Depends on

RankDownloadsName
13,240,425,504bundler
151,154,551,213nokogiri
113385,959,989base64

Owners

#GravatarHandle
1iconpostmodern