Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,435 of 184,936
Downloads: 373,794

Daily

Ranking: 7,067 of 184,921
Downloads: 258

Depended by

RankDownloadsName
8,346383,216katello
14,141131,733validate-website
24,70353,859esearchy
25,84350,548wayback_archiver
47,28422,348monet
67,30713,757contentar
69,00613,285hacker-gems
88,1719,077ronin-web-spider
117,2735,453refract
119,6485,213spidr_cli
138,4244,001stupid_crawler
141,1553,861site_health
176,4961,505snackhack2

Depends on

RankDownloadsName
12,648,106,217bundler
20965,729,637nokogiri
227170,358,226base64

Owners

#GravatarHandle
1iconpostmodern