Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,614 of 183,501
Downloads: 334,366

Daily

Ranking: 8,685 of 183,494
Downloads: 56

Depended by

RankDownloadsName
8,224371,423katello
13,914130,152validate-website
24,32353,437esearchy
25,81049,197wayback_archiver
47,00222,053monet
66,91613,580contentar
68,90813,026hacker-gems
96,8517,689ronin-web-spider
116,9485,356refract
119,5585,100spidr_cli
138,3213,919stupid_crawler
141,0593,782site_health
176,7511,202snackhack2

Depends on

RankDownloadsName
12,458,813,476bundler
20890,404,590nokogiri

Owners

#GravatarHandle
1iconpostmodern