Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,390 of 188,294
Downloads: 433,478

Daily

Ranking: 7,333 of 188,277
Downloads: 105

Depended by

RankDownloadsName
8,490420,265katello
14,530139,127validate-website
25,81854,859esearchy
26,09453,974wayback_archiver
47,14424,189monet
67,21714,875hacker-gems
68,01214,614contentar
75,14612,597ronin-web-spider
120,0105,647spidr_cli
138,8274,315stupid_crawler
141,4064,170site_health
157,6533,423snackhack2

Depends on

RankDownloadsName
13,083,534,422bundler
161,109,595,185nokogiri
130333,262,508base64

Owners

#GravatarHandle
1iconpostmodern