Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,603 of 183,722
Downloads: 337,380

Daily

Ranking: 6,314 of 183,714
Downloads: 185

Depended by

RankDownloadsName
8,227373,285katello
13,945130,438validate-website
24,36753,523esearchy
25,79949,410wayback_archiver
47,04622,099monet
66,97013,608contentar
68,88513,077hacker-gems
96,0137,826ronin-web-spider
116,9655,374refract
119,5595,118spidr_cli
138,3143,933stupid_crawler
141,0393,796site_health
176,5831,288snackhack2

Depends on

RankDownloadsName
12,478,115,663bundler
20896,862,725nokogiri

Owners

#GravatarHandle
1iconpostmodern