Categories: None [Edit]

spider

https://rubygems.org/gems/spider
https://github.com/johnnagro/spider
A Web spidering library: handles robots.txt, scraping, finding more links, and doing it all over again.

Total

Ranking: 8,543 of 197,744
Downloads: 511,613

Daily

Ranking: 11,473 of 197,724
Downloads: 95

Depended by

RankDownloadsName

Depends on

RankDownloadsName

Owners

#GravatarHandle
1iconjohnnagro
2iconmike-burns