Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,422 of 192,692
Downloads: 464,277

Daily

Ranking: 8,848 of 192,666
Downloads: 54

Depended by

RankDownloadsName
8,510454,019katello
14,873143,781validate-website
26,43655,834wayback_archiver
26,48755,646esearchy
47,22625,200monet
66,58715,710hacker-gems
68,85214,954contentar
70,79414,338ronin-web-spider
120,1935,893spidr_cli
132,8674,834snackhack2
139,0964,476stupid_crawler
141,5534,342site_health

Depends on

RankDownloadsName
13,389,621,074bundler
151,188,663,183nokogiri
111429,114,750base64

Owners

#GravatarHandle
1iconpostmodern