Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domain...

Total

Ranking: 8,509 of 195,571
Downloads: 488,341

Daily

Ranking: 8,593 of 195,548
Downloads: 106

Depended by

RankDownloadsName
8,602479,216katello
15,063146,325validate-website
26,50957,225wayback_archiver
26,87855,982esearchy
47,21625,901monet
66,48916,146hacker-gems
68,01315,629ronin-web-spider
69,14315,267contentar
119,7442,080ping_thing
120,3886,044spidr_cli
127,4965,330snackhack2
139,4864,580stupid_crawler
141,8764,447site_health

Depends on

RankDownloadsName
13,608,722,038bundler
151,237,599,660nokogiri
98487,622,293base64

Owners

#GravatarHandle
1iconpostmodern