Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,500 of 197,744
Downloads: 516,415

Daily

Ranking: 6,761 of 197,724
Downloads: 446

Depended by

RankDownloadsName
8,401528,713katello
15,278147,870validate-website
26,70658,104wayback_archiver
27,28056,226esearchy
47,70726,133monet
64,87517,102ronin-web-spider
67,06116,322hacker-gems
69,82115,401contentar
119,7442,080ping_thing
121,4586,110spidr_cli
125,8615,648snackhack2
140,5074,643stupid_crawler
143,0564,501site_health

Depends on

RankDownloadsName
13,863,547,421bundler
161,283,701,651nokogiri
89548,813,460base64

Owners

#GravatarHandle
1iconpostmodern