Categories: Web Crawling [Edit]

spidr

https://rubygems.org/gems/spidr
https://github.com/postmodern/spidr
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Total

Ranking: 8,813 of 188,756
Downloads: 268,634

Daily

Ranking: 4,978 of 188,734
Downloads: 555

Depended by

RankDownloadsName
13,421124,647validate-website
23,49351,939esearchy
25,78145,625wayback_archiver
46,19121,129monet
66,04712,983contentar
68,63312,287hacker-gems
116,8495,019refract
119,6184,762spidr_cli
124,3404,427ronin-web-spider
138,3833,676stupid_crawler
141,4423,537site_health

Depends on

RankDownloadsName
12,028,452,460bundler
21776,067,650nokogiri

Owners

#GravatarHandle
1iconpostmodern